-- Logs begin at Tue 2022-08-23 23:43:06 UTC, end at Wed 2022-08-24 00:39:44 UTC. -- Aug 24 00:12:45.595227 dv-osbrick-853778-3-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 00:12:45.606960 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 00:12:45.609059 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 00:12:45 2022] *** Aug 24 00:12:45.609059 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 00:12:45.609059 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 00:12:45.609059 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: nodename: dv-osbrick-853778-3-ceph Aug 24 00:12:45.609059 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: machine: x86_64 Aug 24 00:12:45.609059 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: clock source: unix Aug 24 00:12:45.609059 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: pcre jit disabled Aug 24 00:12:45.609059 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: detected number of CPU cores: 4 Aug 24 00:12:45.609059 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: current working directory: / Aug 24 00:12:45.609059 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: detected binary path: /usr/bin/uwsgi-core Aug 24 00:12:45.609580 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: your processes number limit is 47680 Aug 24 00:12:45.609580 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: your memory page size is 4096 bytes Aug 24 00:12:45.609580 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: detected max file descriptor number: 2048 Aug 24 00:12:45.609580 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: lock engine: pthread robust mutexes Aug 24 00:12:45.609580 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: thunder lock: enabled Aug 24 00:12:45.609580 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 00:12:45.609580 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 00:12:45.653501 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: Python main interpreter initialized at 0x5644593379c0 Aug 24 00:12:45.653501 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: python threads support enabled Aug 24 00:12:45.653501 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: your server socket listen backlog is limited to 100 connections Aug 24 00:12:45.653501 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: your mercy for graceful operations on workers is 90 seconds Aug 24 00:12:45.653871 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 00:12:45.653945 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: *** Operational MODE: preforking *** Aug 24 00:12:45.654181 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: *** uWSGI is running in multiple interpreter mode *** Aug 24 00:12:45.654181 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: spawned uWSGI master process (pid: 94649) Aug 24 00:12:45.654381 dv-osbrick-853778-3-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 24 00:12:45.659091 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: spawned uWSGI worker 1 (pid: 94660, cores: 1) Aug 24 00:12:45.659091 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: spawned uWSGI worker 2 (pid: 94661, cores: 1) Aug 24 00:12:45.659091 dv-osbrick-853778-3-ceph devstack@keystone.service[94649]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 00:12:50.288041 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 00:12:50.288041 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: from cryptography.utils import int_from_bytes Aug 24 00:12:50.288880 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 00:12:50.288880 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: from cryptography.utils import int_from_bytes Aug 24 00:12:50.288880 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 00:12:50.288880 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: from cryptography.utils import int_from_bytes Aug 24 00:12:50.289447 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 00:12:50.289447 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: from cryptography.utils import int_from_bytes Aug 24 00:12:50.339088 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 00:12:50.339305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 00:12:50.339455 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] command line args: [] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 00:12:50.339549 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 00:12:50.339663 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 00:12:50.339748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 00:12:50.339860 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] command line args: [] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 00:12:50.339965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ================================================================================ {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 00:12:50.340126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] admin_token = **** {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.340219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 00:12:50.340292 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ================================================================================ {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 00:12:50.340372 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] config_dir = [] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.340543 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.340627 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] admin_token = **** {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.340732 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] config_source = [] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.340816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] config_dir = [] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.340892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] debug = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.340971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.341097 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.341345 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] config_source = [] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.341345 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] debug = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.341464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.341534 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.341624 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] insecure_debug = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.341776 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.341883 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.341984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] insecure_debug = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.342086 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.342187 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.342313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] list_limit = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.342422 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.342523 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] log_config_append = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.342623 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] list_limit = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.342728 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.342836 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] log_config_append = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.342936 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] log_dir = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.343068 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.343175 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] log_file = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.343277 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] log_dir = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.343382 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.343493 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] log_file = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.343611 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.343691 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.343810 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.343890 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.344012 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.344094 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.344214 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.344289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.344410 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.344569 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.344651 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.344728 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.344850 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.345043 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.345132 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.345215 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.345292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.345416 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.345496 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.345572 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.345764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.345919 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.346129 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.346233 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.346323 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] notification_format = cadf {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.346393 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.346509 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.346594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] notification_format = cadf {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.346801 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.346885 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.346982 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] publish_errors = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.347236 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.347317 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.347466 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.347542 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] publish_errors = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.347668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.347788 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.347905 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.348016 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.348126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.348257 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.348389 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] standard_threads = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.348526 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.348653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] strict_password_check = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.348777 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.348898 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.349011 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] standard_threads = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.349124 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] use_eventlog = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.349245 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] strict_password_check = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.349357 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] use_journal = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.349357 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] use_json = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.349619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.349724 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] use_stderr = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.349825 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] use_eventlog = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.349920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] use_syslog = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.350013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] use_journal = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.350013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] use_json = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.350220 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] watch_log_file = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.350333 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] use_stderr = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.350451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.350563 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] use_syslog = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.350673 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.350783 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] watch_log_file = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 00:12:50.350902 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.351042 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.351144 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.351249 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.351345 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.351444 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.351554 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.351651 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.351744 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.351844 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.351939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.352032 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.352137 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.352254 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.352366 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.352482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.352600 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.352778 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.352916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.353036 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.353153 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.353271 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.353389 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.353501 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.353619 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.353741 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.353854 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.353971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.354082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.354192 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.354310 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.354429 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.354547 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.354664 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.354776 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.354891 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.355105 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.355228 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.355348 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.355467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.355585 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.355704 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.355823 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.355941 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.356052 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.356163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.356278 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.356397 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.356510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.356626 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.356738 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.356848 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.356957 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.357075 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.357193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.357304 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.357419 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.357531 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.357647 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.357647 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.357868 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.357978 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.358087 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.358087 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.358301 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.358497 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.358619 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.358730 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.358840 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.358840 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.359059 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.359191 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.359391 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.359518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.359638 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.359749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.359860 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.359978 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.360091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.360202 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.360312 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.360423 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.360533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.360723 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.360838 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.360956 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.361073 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.361191 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.361309 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.361927 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.362087 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.362224 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.362337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.362448 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.362565 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.362689 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.362804 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.362921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.363080 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.363196 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.363306 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.363425 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.364137 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.364264 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.364378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.364479 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.364911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.365123 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.365251 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.365366 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.365544 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.365694 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.365949 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.366109 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.366233 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.366348 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.366810 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.366934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.367134 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.367253 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.367444 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.367585 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.367685 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.367817 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.367940 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.368080 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.368208 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.368358 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.368482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.372246 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.372391 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.372499 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.372617 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.372720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.372816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.372911 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.373006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.373101 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.373101 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.373295 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.373393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.373488 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.373590 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.373686 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.373800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.enabled = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.373902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.373998 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.374092 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.374192 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.374288 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.374390 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.374492 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.374588 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.374690 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.enabled = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.374784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.374879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.374986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.374986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.375196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.375302 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.375400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.375501 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.375611 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.375714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.375815 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.375934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.376220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.376318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.376424 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.376539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.376657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.376778 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.376891 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.377034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.378101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.378235 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.378350 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.378464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.378578 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.378691 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.378887 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.379075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.379204 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.379319 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.379432 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.379560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.379686 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.379809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.379929 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.380049 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.380162 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.380274 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.380387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.380497 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.380611 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.380730 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.380849 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.380962 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.381074 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.381194 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.381309 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.381421 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] auth.external = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.381533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.381646 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] auth.mapped = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.381765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.381887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.382002 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.382115 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.382235 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.382361 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] auth.password = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.382475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.382619 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] auth.token = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.382744 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] auth.external = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.382867 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.382982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] auth.mapped = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.383126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] catalog.caching = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.383242 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.383357 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.383470 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.383615 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.383748 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] auth.password = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.383863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.383977 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] auth.token = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.384097 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.384212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.384333 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.384448 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] catalog.caching = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.384562 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] credential.caching = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.384683 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.384800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] credential.driver = sql {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.384913 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.385034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.385150 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.385265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.385379 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.385492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.385605 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.385727 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.385843 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] credential.caching = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.385957 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.386070 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] credential.driver = sql {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.386183 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.386295 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.386418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.386418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.386640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.386753 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.386868 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.386868 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.387104 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.387220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.387333 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.387446 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.387558 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.387678 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.387801 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.387923 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.388048 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.388048 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] federation.caching = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.388266 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.388379 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.388500 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.388615 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] federation.driver = sql {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.388729 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.388842 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.388956 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.389069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.389191 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.389311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.389431 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.389544 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.389657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] federation.caching = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.389778 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.389894 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.390015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.390129 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] federation.driver = sql {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.390241 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.390355 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.390476 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.390591 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.390703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.390816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.390929 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] identity.caching = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.391123 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.391252 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.391368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.391481 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.391594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.391708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.391821 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.391943 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.392058 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.392172 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] identity.driver = sql {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.392285 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.392398 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.392519 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] identity.caching = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.392752 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.392880 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.392995 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.393109 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.393223 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.393336 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.393462 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.393577 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.393691 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.393691 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.393909 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] identity.driver = sql {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.393909 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.394130 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.394246 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.394359 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.394359 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.394568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.394568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.394759 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.394839 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.394911 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.394982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.395114 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.395229 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.395355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.395472 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.395585 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.395704 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.395819 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.395932 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.396052 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.396052 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.396266 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.396380 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.396492 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.396605 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.396726 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.396840 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.396953 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.397066 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.397178 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.397297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.397424 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.397539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.397652 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.397790 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.397905 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.398026 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.398150 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.398266 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.398379 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.398492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.398604 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.398722 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.398845 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.398960 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.399129 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.399247 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.password = **** {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.399361 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.399503 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.399669 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.399789 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.399903 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.400016 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.400129 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.400251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.400366 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.400480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.400593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.400705 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.400818 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.400939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.401054 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.password = **** {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.401168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.401287 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.401408 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.401522 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.401644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.401759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.401873 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.401992 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.402107 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.402219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.402340 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.402455 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.402567 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.402681 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.402794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.user = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.402907 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.403050 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.403168 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.403281 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.403394 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.403507 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.403619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.403740 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.403855 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.403968 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.404080 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.404199 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.404313 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.404435 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.404550 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.user = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.404663 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.404776 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.404896 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.405010 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.405132 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.405247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.405367 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.405367 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.405581 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.405694 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.405816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.405931 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.406044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.406147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.406258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.406377 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.406500 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.406500 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.406713 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.406826 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.406939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.407073 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.407198 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.407313 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.407426 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.407578 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.407691 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.407804 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.407925 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.408039 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.408152 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.408292 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.408410 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.408523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.408645 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.408759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.408873 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.408985 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.409101 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] policy.driver = sql {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.409215 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.409337 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.409451 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.409564 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.409676 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.409789 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.409908 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.410031 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] receipt.caching = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.410146 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.410258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.410377 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.410491 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.410603 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.410724 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.410724 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.410936 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] policy.driver = sql {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.411108 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.411223 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.411335 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] resource.caching = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.411460 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.411575 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.411688 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.411800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] resource.driver = sql {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.411912 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] receipt.caching = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.412026 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.412147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.412261 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.412374 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.412486 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.412598 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.412710 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] revoke.caching = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.412831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.412946 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.413059 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.413172 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.413284 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] resource.caching = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.413396 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] role.cache_time = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.413517 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.413630 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] role.caching = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.413743 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] resource.driver = sql {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.413856 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] role.driver = sql {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.413969 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.414089 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] role.list_limit = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.414205 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.414317 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.414429 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.414548 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.414662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] revoke.caching = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.414853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.414971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.415115 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.415275 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.415392 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.415570 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] role.cache_time = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.415701 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.415818 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] role.caching = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.415932 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.416045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] role.driver = sql {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.416158 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.416271 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] role.list_limit = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.416392 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.416507 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.416620 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.416733 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.416846 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.416960 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.417082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.417197 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.417311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.417425 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.417425 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.417627 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.417732 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.417830 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.417942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.418055 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.418167 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.418280 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.418402 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.418517 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.418629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.418742 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.418855 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.418968 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.419144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.419261 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.419261 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.419475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.419588 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.419709 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.420081 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.420200 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.420313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.420428 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.420540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.420671 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.420787 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.420901 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.421014 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.421126 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.421239 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.421239 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.421462 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.421576 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.421694 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.421808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] token.cache_time = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.421927 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.422052 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] token.caching = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.422173 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.422288 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.422400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.422514 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] token.provider = fernet {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.422626 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.422747 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.422861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.422974 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.423115 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.423231 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.423344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.423464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.423580 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.423693 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.423806 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.424430 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.424546 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] token.cache_time = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.424670 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] trust.driver = sql {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.424785 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] token.caching = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.424898 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.425011 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.425124 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.425238 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] token.provider = fernet {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.425359 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.425475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.425587 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.425701 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.425814 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.425926 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.426048 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.426163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.426276 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.426388 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.426501 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.426613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.426735 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.connection = **** {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.426858 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] trust.driver = sql {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.426981 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.427218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.427333 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.427456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.427571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.427693 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.427809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.427923 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.428035 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.428148 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.428261 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.428381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.428496 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.428609 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.428721 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.428836 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.428949 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.429070 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.connection = **** {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.429193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.429320 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.429435 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.429553 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.429666 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.429780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.429894 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.430016 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.430130 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.430244 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.430356 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.430469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.430582 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.430703 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.430874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.430874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.432046 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.432356 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 00:12:50.432480 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.432480 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.432480 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.432480 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.432480 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.432480 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.432480 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.432480 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.432480 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.433552 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 00:12:50.433552 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 00:12:50.453133 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.453363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.453585 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.454692 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.454937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.455223 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.461923 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.463662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.491459 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.491685 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.493461 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.493894 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.543502 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.543942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.593719 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.593868 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.594008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.594093 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.661120 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.661352 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.661573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.661663 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.661796 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.661878 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.662020 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.662111 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.662240 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.662321 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.662459 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.662673 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.686117 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.686277 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.686365 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.686510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.686596 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.686732 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.686816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.686955 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.687055 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.687206 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.687323 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.687419 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.687562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.687685 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.699259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.699362 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.712172 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.712296 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.712406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.712516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.712631 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.712729 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.712852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.712962 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.713068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.713184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.713283 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.713404 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.713485 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.713622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 00:12:50.730212 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.730322 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.730415 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 00:12:50.730524 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 00:12:50.730752 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.730869 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.730949 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 00:12:50.731096 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 00:12:50.731247 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.731380 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.731513 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.731650 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.731775 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.731916 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.732034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.732179 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.742050 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.742218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.742334 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.742504 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.742612 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.742783 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.742903 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.743104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.749853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=94661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.750025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=94660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.753325 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=94661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.753553 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=94660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.753635 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.753841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.753924 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.754131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.754212 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.754421 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.754516 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.754683 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.754764 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.754954 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.755066 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.755251 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.755345 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.755523 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.755603 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.755796 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.755875 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.756064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.756146 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.756337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.780107 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.780470 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.781579 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=94661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.781868 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.781952 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=94660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.782222 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.786947 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=94661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.787268 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.787365 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=94660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.787559 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.787694 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.787876 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.794080 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=94661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.794324 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.794408 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=94660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.794665 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.798446 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=94661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.798744 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.798825 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=94660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.799600 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.799694 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.799890 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.799971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.800181 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.800275 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.800472 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.800578 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.800855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.800934 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.801131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.801211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.801416 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.816847 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.817129 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.817249 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.817533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.820997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=94661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.821444 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=94660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.824112 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.824411 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.824570 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.824883 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.828737 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=94661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.829221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=94660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.832054 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=94661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.832430 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=94660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.835174 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.835478 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.835604 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.835768 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.835912 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.836058 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.836205 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.836346 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.836499 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.836730 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.836811 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.837168 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.852907 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=94661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.853189 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.853375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=94660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.853460 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.853670 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.853751 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.853958 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.854228 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.860497 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.861010 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.862756 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.863063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.863313 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.863599 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.865732 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=94661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.866022 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.866308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=94660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.866397 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.866601 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.866691 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.866931 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.867067 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.867246 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.867537 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.878328 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=94661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.878617 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.878698 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=94660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.878903 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.878985 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.879217 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.879301 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.879502 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.879584 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.879778 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.879864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.880053 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.880202 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.880379 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.895403 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=94661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.895748 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=94660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.898309 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=94661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.898657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=94660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.901313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.901673 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.902754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.903155 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.904261 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=94661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.904547 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.904628 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=94660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.904834 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.904917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.905189 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.911847 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.912206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.913323 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=94661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.913675 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=94660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.916222 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.916515 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.916599 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.916809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.916900 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.917090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.917172 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.917441 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.926529 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=94661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.926830 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.926915 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=94660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.927142 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.927227 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.927509 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.933878 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=94661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.934263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=94660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 00:12:50.934348 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.934549 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.934662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.934833 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.934954 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.935138 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.935265 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.935423 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.935548 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.935712 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.935833 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.936007 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.936117 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.936290 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.936415 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.936565 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.936703 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.936844 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.936983 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.937114 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.937264 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.937367 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.937534 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.937639 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=94661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.937811 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.938088 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=94660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 00:12:50.970630 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5644593379c0 pid: 94661 (default app) Aug 24 00:12:50.971651 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5644593379c0 pid: 94660 (default app) Aug 24 00:12:50.974570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71ff92-91cd-44eb-b039-f8431c767847 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:12:50.974863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71ff92-91cd-44eb-b039-f8431c767847 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:12:50.975177 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71ff92-91cd-44eb-b039-f8431c767847 None None] PATH_INFO: `/v3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:12:50.979349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Wed Aug 24 00:12:50 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:12:58.044366 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af73583-19d8-47ed-9306-cd2e4df845db None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:12:58.044861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af73583-19d8-47ed-9306-cd2e4df845db None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:12:58.044942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af73583-19d8-47ed-9306-cd2e4df845db None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:12:58.049179 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:12:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:12:58.054367 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6d223-0b41-42ad-9c1b-35c5735839bb None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:12:58.054730 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6d223-0b41-42ad-9c1b-35c5735839bb None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:12:58.054914 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6d223-0b41-42ad-9c1b-35c5735839bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:12:58.132028 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: INFO dbcounter [None req-f4e6d223-0b41-42ad-9c1b-35c5735839bb None None] Registered counter for database keystone Aug 24 00:12:58.151577 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG oslo_db.sqlalchemy.engines [None req-f4e6d223-0b41-42ad-9c1b-35c5735839bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 00:12:58.157885 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writer thread running {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 00:12:58.343367 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG passlib.handlers.bcrypt [None req-f4e6d223-0b41-42ad-9c1b-35c5735839bb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=94661) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 00:12:58.343696 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG passlib.handlers.bcrypt [None req-f4e6d223-0b41-42ad-9c1b-35c5735839bb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=94661) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 00:12:58.400246 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-f4e6d223-0b41-42ad-9c1b-35c5735839bb None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:12:58.401847 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-f4e6d223-0b41-42ad-9c1b-35c5735839bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:12:58.531243 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:12:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 00:12:59.030940 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af73583-19d8-47ed-9306-cd2e4df845db None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:12:59.106891 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: INFO dbcounter [None req-8af73583-19d8-47ed-9306-cd2e4df845db None None] Registered counter for database keystone Aug 24 00:12:59.128546 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG oslo_db.sqlalchemy.engines [None req-8af73583-19d8-47ed-9306-cd2e4df845db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 00:12:59.135049 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writer thread running {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 00:12:59.255150 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af73583-19d8-47ed-9306-cd2e4df845db None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:12:59.259481 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f059f07-9ffa-4bb4-b2ef-54854a5e6b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:12:59.260101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f059f07-9ffa-4bb4-b2ef-54854a5e6b3d admin admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:12:59.260386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f059f07-9ffa-4bb4-b2ef-54854a5e6b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:12:59.260663 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f059f07-9ffa-4bb4-b2ef-54854a5e6b3d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:12:59.268846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f059f07-9ffa-4bb4-b2ef-54854a5e6b3d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:12:59.320785 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8f059f07-9ffa-4bb4-b2ef-54854a5e6b3d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 00:12:59.321067 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f059f07-9ffa-4bb4-b2ef-54854a5e6b3d admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:12:59.331085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Aug 24 00:12:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 00:12:59.337280 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6d223-0b41-42ad-9c1b-35c5735839bb None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:12:59.354166 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6d223-0b41-42ad-9c1b-35c5735839bb None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:12:59.358476 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de266ee0-f778-4e0e-9f39-36506b115f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:12:59.359614 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de266ee0-f778-4e0e-9f39-36506b115f25 admin admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:12:59.359897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de266ee0-f778-4e0e-9f39-36506b115f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:12:59.360175 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de266ee0-f778-4e0e-9f39-36506b115f25 admin admin] PATH_INFO: `/v3/projects/792d367d504f4db2950fddd56501d7c3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:12:59.362154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de266ee0-f778-4e0e-9f39-36506b115f25 admin admin] RBAC: Authorizing `identity:get_project(project_id=792d367d504f4db2950fddd56501d7c3)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:12:59.412065 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: WARNING keystone.common.rbac_enforcer.enforcer [None req-de266ee0-f778-4e0e-9f39-36506b115f25 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 00:12:59.412406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de266ee0-f778-4e0e-9f39-36506b115f25 admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:12:59.417574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Aug 24 00:12:59 2022] GET /identity/v3/projects/792d367d504f4db2950fddd56501d7c3 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:01.596877 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290e472-2b98-4ba9-8ef9-da338ac78ed7 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:01.597439 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290e472-2b98-4ba9-8ef9-da338ac78ed7 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:01.597439 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290e472-2b98-4ba9-8ef9-da338ac78ed7 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:01.601498 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:13:01.607114 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b740363-a07b-44db-9683-28ed80a60eed None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:01.607534 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b740363-a07b-44db-9683-28ed80a60eed None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:01.607670 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b740363-a07b-44db-9683-28ed80a60eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:01.629082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-0b740363-a07b-44db-9683-28ed80a60eed None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:01.630737 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-0b740363-a07b-44db-9683-28ed80a60eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:01.638758 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 00:13:01.969026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290e472-2b98-4ba9-8ef9-da338ac78ed7 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:01.982355 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290e472-2b98-4ba9-8ef9-da338ac78ed7 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:01.987156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70ba56-36bc-48ba-bc22-40effe30177f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:01.987754 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70ba56-36bc-48ba-bc22-40effe30177f admin admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:01.988039 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70ba56-36bc-48ba-bc22-40effe30177f admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:01.988319 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70ba56-36bc-48ba-bc22-40effe30177f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:01.996363 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70ba56-36bc-48ba-bc22-40effe30177f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:01.998174 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70ba56-36bc-48ba-bc22-40effe30177f admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:02.009130 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Aug 24 00:13:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 00:13:02.015408 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b740363-a07b-44db-9683-28ed80a60eed None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:02.024801 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b740363-a07b-44db-9683-28ed80a60eed None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:02.029196 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd49b04-82b7-4e2a-9595-41a64714109a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:02.029813 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd49b04-82b7-4e2a-9595-41a64714109a admin admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:02.030095 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd49b04-82b7-4e2a-9595-41a64714109a admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:02.030390 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd49b04-82b7-4e2a-9595-41a64714109a admin admin] PATH_INFO: `/v3/users/ba9622273acc4179a07cafb4c9699780` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:02.031738 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd49b04-82b7-4e2a-9595-41a64714109a admin admin] RBAC: Authorizing `identity:get_user(user_id=ba9622273acc4179a07cafb4c9699780)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:02.034189 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd49b04-82b7-4e2a-9595-41a64714109a admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:02.035794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Aug 24 00:13:02 2022] GET /identity/v3/users/ba9622273acc4179a07cafb4c9699780 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:04.329555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2f400-17c7-49ff-8642-4d6e902daa2b None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:04.330600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2f400-17c7-49ff-8642-4d6e902daa2b None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:04.330693 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2f400-17c7-49ff-8642-4d6e902daa2b None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:04.332073 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:04.337346 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3050fb-45ea-4665-ba0a-d6fcb6c07a61 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:04.337767 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3050fb-45ea-4665-ba0a-d6fcb6c07a61 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:04.337901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3050fb-45ea-4665-ba0a-d6fcb6c07a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:04.339602 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613d508-4efe-404c-a13f-6e9bf5e0f85a None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:04.339888 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613d508-4efe-404c-a13f-6e9bf5e0f85a None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:04.340161 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613d508-4efe-404c-a13f-6e9bf5e0f85a None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:04.341532 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:13:04.346525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf4ed0-43ec-418b-87fc-78714fe51056 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:04.346806 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf4ed0-43ec-418b-87fc-78714fe51056 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:04.347112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf4ed0-43ec-418b-87fc-78714fe51056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:04.356519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-fb3050fb-45ea-4665-ba0a-d6fcb6c07a61 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:04.357960 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-fb3050fb-45ea-4665-ba0a-d6fcb6c07a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:04.389890 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG passlib.handlers.bcrypt [None req-a6cf4ed0-43ec-418b-87fc-78714fe51056 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=94660) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 00:13:04.390310 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG passlib.handlers.bcrypt [None req-a6cf4ed0-43ec-418b-87fc-78714fe51056 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=94660) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 00:13:04.437181 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-a6cf4ed0-43ec-418b-87fc-78714fe51056 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:04.438856 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-a6cf4ed0-43ec-418b-87fc-78714fe51056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:04.548957 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:04.557772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:13:04.877871 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3050fb-45ea-4665-ba0a-d6fcb6c07a61 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:04.883463 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf4ed0-43ec-418b-87fc-78714fe51056 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:04.902407 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:04.981257 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:04.984426 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf4ed0-43ec-418b-87fc-78714fe51056 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:04.984910 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3050fb-45ea-4665-ba0a-d6fcb6c07a61 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:05.020259 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27166a2e-61f9-46ff-a0cb-238eec5cb7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:05.020868 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27166a2e-61f9-46ff-a0cb-238eec5cb7e7 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:05.021149 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27166a2e-61f9-46ff-a0cb-238eec5cb7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:05.021423 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27166a2e-61f9-46ff-a0cb-238eec5cb7e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:05.023439 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2998c-3f9b-456f-975c-d72820419a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:05.024682 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2998c-3f9b-456f-975c-d72820419a9c None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:05.024967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2998c-3f9b-456f-975c-d72820419a9c None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:05.025238 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2998c-3f9b-456f-975c-d72820419a9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:05.037481 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2998c-3f9b-456f-975c-d72820419a9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:05.046004 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-0fd2998c-3f9b-456f-975c-d72820419a9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:13:05.046004 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:05.046004 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:05.046004 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:05.046004 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:05.046004 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:05.046004 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:05.046004 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:05.046004 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:05.046004 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:05.046004 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:05.046004 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:05.046004 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:05.046004 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:05.046004 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:05.046004 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:05.047028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:05.047028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:05.047028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:05.047028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:05.047028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:05.047028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:05.047028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:05.047028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:05.047028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:05.047028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:05.047028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:05.047028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:05.047028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:05.047028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:05.047028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:05.047028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:05.047857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:05.047857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:05.047857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:05.047857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:05.047857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:05.047857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:05.047857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:05.047857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:05.047857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:05.047857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:05.047857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:13:05.047857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:05.047857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 8/14] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 00:13:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:13:05.053576 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2998c-3f9b-456f-975c-d72820419a9c None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:05.090126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27166a2e-61f9-46ff-a0cb-238eec5cb7e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:05.091644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27166a2e-61f9-46ff-a0cb-238eec5cb7e7 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:05.116297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:05.153035 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2998c-3f9b-456f-975c-d72820419a9c None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:05.187804 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb70fc1-d2fa-4e17-9386-119694800962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:05.188432 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb70fc1-d2fa-4e17-9386-119694800962 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:05.188715 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb70fc1-d2fa-4e17-9386-119694800962 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:05.189023 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb70fc1-d2fa-4e17-9386-119694800962 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:05.189695 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb70fc1-d2fa-4e17-9386-119694800962 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:05.189998 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb70fc1-d2fa-4e17-9386-119694800962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:05.191751 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb70fc1-d2fa-4e17-9386-119694800962 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:05.199920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 7/15] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:13:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:13:05.203613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 9/16] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:05.205566 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27166a2e-61f9-46ff-a0cb-238eec5cb7e7 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:05.208781 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb70fc1-d2fa-4e17-9386-119694800962 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:05.232970 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:05.306017 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27166a2e-61f9-46ff-a0cb-238eec5cb7e7 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:05.309399 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb70fc1-d2fa-4e17-9386-119694800962 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:05.328587 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:05.340371 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc0331-c901-4dcf-b73b-e4ff0fa1308a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:05.341001 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc0331-c901-4dcf-b73b-e4ff0fa1308a None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:05.341275 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc0331-c901-4dcf-b73b-e4ff0fa1308a None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:05.341547 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc0331-c901-4dcf-b73b-e4ff0fa1308a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:05.344853 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099abb8-1c08-48c6-923e-5d09708d8591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:05.345989 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099abb8-1c08-48c6-923e-5d09708d8591 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:05.346266 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099abb8-1c08-48c6-923e-5d09708d8591 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:05.346537 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099abb8-1c08-48c6-923e-5d09708d8591 None admin] PATH_INFO: `/v3/users/ba9622273acc4179a07cafb4c9699780` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:05.347980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099abb8-1c08-48c6-923e-5d09708d8591 None admin] RBAC: Authorizing `identity:get_user(user_id=ba9622273acc4179a07cafb4c9699780)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:05.349444 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099abb8-1c08-48c6-923e-5d09708d8591 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:05.351103 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 10/17] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:05 2022] GET /identity/v3/users/ba9622273acc4179a07cafb4c9699780 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:05.352004 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc0331-c901-4dcf-b73b-e4ff0fa1308a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:05.353572 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc0331-c901-4dcf-b73b-e4ff0fa1308a None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:05.356787 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099abb8-1c08-48c6-923e-5d09708d8591 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:05.374266 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-b9fc0331-c901-4dcf-b73b-e4ff0fa1308a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:13:05.374266 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:05.374266 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:05.374266 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:05.374266 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:05.374266 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:05.374266 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:05.374266 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:05.374266 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:05.374266 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:05.374266 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:05.374266 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:05.374266 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:13:05.374266 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:13:05.374266 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:13:05.374266 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:13:05.375258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:05.375258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:05.375258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:05.375258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:05.375258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:05.375258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:05.375258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:05.375258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:05.375258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:05.375258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:05.375258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:05.375258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:05.375258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:05.375258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:05.375258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:05.375258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:05.375258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:13:05.376053 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:13:05.376053 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:13:05.376053 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:13:05.376053 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 8/18] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:05.381707 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc0331-c901-4dcf-b73b-e4ff0fa1308a None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:05.490460 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc0331-c901-4dcf-b73b-e4ff0fa1308a None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:05.529722 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f593b6-279b-4eb1-9e50-80ea5d227a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:05.530327 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f593b6-279b-4eb1-9e50-80ea5d227a1d None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:05.530609 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f593b6-279b-4eb1-9e50-80ea5d227a1d None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:05.530914 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f593b6-279b-4eb1-9e50-80ea5d227a1d None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:05.531595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f593b6-279b-4eb1-9e50-80ea5d227a1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:05.531902 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f593b6-279b-4eb1-9e50-80ea5d227a1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:05.533862 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f593b6-279b-4eb1-9e50-80ea5d227a1d None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:05.550892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 9/19] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:05.568199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:05.579024 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099abb8-1c08-48c6-923e-5d09708d8591 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:05.616402 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50932b6-4b8a-4da6-b3a9-bce691077964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:05.617045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50932b6-4b8a-4da6-b3a9-bce691077964 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:05.617323 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50932b6-4b8a-4da6-b3a9-bce691077964 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:05.617593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50932b6-4b8a-4da6-b3a9-bce691077964 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:05.619381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50932b6-4b8a-4da6-b3a9-bce691077964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:05.620651 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50932b6-4b8a-4da6-b3a9-bce691077964 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:05.622277 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 11/20] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:13:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:05.628362 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f593b6-279b-4eb1-9e50-80ea5d227a1d None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:05.665942 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:05.735861 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f593b6-279b-4eb1-9e50-80ea5d227a1d None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:05.771028 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc39acd-e986-4c34-8fd7-609e09740252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:05.771683 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc39acd-e986-4c34-8fd7-609e09740252 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:05.772247 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc39acd-e986-4c34-8fd7-609e09740252 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:05.772524 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc39acd-e986-4c34-8fd7-609e09740252 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:05.773254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc39acd-e986-4c34-8fd7-609e09740252 None admin] RBAC: Adding query filter params (role.id=9b372d4fe82a4a54a3ecd29e7b912586, scope.domain.id=default, user.id=ba9622273acc4179a07cafb4c9699780) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:05.773565 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc39acd-e986-4c34-8fd7-609e09740252 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:05.775096 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc39acd-e986-4c34-8fd7-609e09740252 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:05.782222 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 10/21] 10.222.0.42 () {56 vars in 1322 bytes} [Wed Aug 24 00:13:05 2022] GET /identity/v3/role_assignments?user.id=ba9622273acc4179a07cafb4c9699780&scope.domain.id=default&role.id=9b372d4fe82a4a54a3ecd29e7b912586 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:08.312616 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87f706-fb48-42eb-9fac-563ac57b84b6 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:08.313151 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87f706-fb48-42eb-9fac-563ac57b84b6 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:08.313151 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87f706-fb48-42eb-9fac-563ac57b84b6 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:08.314837 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 12/22] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:08.320508 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78a878-f4a8-4bf0-a6be-9454552c7a45 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:08.320903 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78a878-f4a8-4bf0-a6be-9454552c7a45 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:08.321083 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78a878-f4a8-4bf0-a6be-9454552c7a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:08.347505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-2b78a878-f4a8-4bf0-a6be-9454552c7a45 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:08.348699 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-2b78a878-f4a8-4bf0-a6be-9454552c7a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:08.447030 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 11/23] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:08.741454 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948bff0-30e4-4546-bbba-c1d1caa995a7 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:08.741786 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948bff0-30e4-4546-bbba-c1d1caa995a7 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:08.741954 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948bff0-30e4-4546-bbba-c1d1caa995a7 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:08.743528 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:08.754450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5630c-edb4-4405-b8e1-58ebcfbf0eec None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:08.754742 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5630c-edb4-4405-b8e1-58ebcfbf0eec None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:08.755047 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5630c-edb4-4405-b8e1-58ebcfbf0eec None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:08.756649 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 12/25] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:08.757028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e6194-0e8d-41ca-b2c2-8e96afb6ef4f None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:08.757324 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e6194-0e8d-41ca-b2c2-8e96afb6ef4f None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:08.757605 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e6194-0e8d-41ca-b2c2-8e96afb6ef4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:08.761618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1de810-4c6b-4e2a-8808-434a41fb4d28 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:08.761906 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1de810-4c6b-4e2a-8808-434a41fb4d28 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:08.762183 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1de810-4c6b-4e2a-8808-434a41fb4d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:08.788761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-952e6194-0e8d-41ca-b2c2-8e96afb6ef4f None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:08.790582 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-952e6194-0e8d-41ca-b2c2-8e96afb6ef4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:08.792006 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-4c1de810-4c6b-4e2a-8808-434a41fb4d28 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:08.793321 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-4c1de810-4c6b-4e2a-8808-434a41fb4d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:08.831272 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:08.903484 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 13/26] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:13:08.905179 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5daf8-500a-4847-82dd-dfbc531121e4 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:08.905687 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5daf8-500a-4847-82dd-dfbc531121e4 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:08.906163 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5daf8-500a-4847-82dd-dfbc531121e4 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:08.907658 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 14/27] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:08.908532 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5daf8-500a-4847-82dd-dfbc531121e4 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:08.914457 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 14/28] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:13:08.919810 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3a7f7-a317-44b3-ac5f-85402d94f3ea None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:08.920614 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3a7f7-a317-44b3-ac5f-85402d94f3ea None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:08.921060 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3a7f7-a317-44b3-ac5f-85402d94f3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:08.953981 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-caa3a7f7-a317-44b3-ac5f-85402d94f3ea None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:08.955737 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-caa3a7f7-a317-44b3-ac5f-85402d94f3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:09.081306 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 15/29] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:13:09.092221 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5daf8-500a-4847-82dd-dfbc531121e4 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:09.146753 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40565d99-7ff3-4292-b283-3620a98a1e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:09.147795 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40565d99-7ff3-4292-b283-3620a98a1e24 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:09.148273 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40565d99-7ff3-4292-b283-3620a98a1e24 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:09.148760 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40565d99-7ff3-4292-b283-3620a98a1e24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:09.166195 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40565d99-7ff3-4292-b283-3620a98a1e24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:09.168021 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40565d99-7ff3-4292-b283-3620a98a1e24 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:09.186986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-40565d99-7ff3-4292-b283-3620a98a1e24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:13:09.186986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:09.186986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:09.186986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:09.186986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:09.186986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:09.186986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:09.186986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:09.186986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:09.186986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:09.186986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:09.186986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:09.186986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:13:09.186986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:13:09.186986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:13:09.186986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:13:09.187897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:09.187897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:09.187897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:09.187897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:09.187897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:09.187897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:09.187897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:09.187897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:09.187897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:09.187897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:09.187897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:09.187897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:09.187897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:09.187897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:09.187897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:09.187897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:09.187897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:13:09.188714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:13:09.188714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:13:09.188714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:13:09.190469 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 15/30] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:09.196646 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3a7f7-a317-44b3-ac5f-85402d94f3ea None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:09.217830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:09.303120 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3a7f7-a317-44b3-ac5f-85402d94f3ea None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:09.332894 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40565d99-7ff3-4292-b283-3620a98a1e24 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:09.352208 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:09.357439 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161fcd3-9ad1-48bf-9e40-17c799ab516a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:09.358065 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161fcd3-9ad1-48bf-9e40-17c799ab516a None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:09.358347 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161fcd3-9ad1-48bf-9e40-17c799ab516a None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:09.358621 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161fcd3-9ad1-48bf-9e40-17c799ab516a None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:09.359298 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161fcd3-9ad1-48bf-9e40-17c799ab516a None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:09.359601 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161fcd3-9ad1-48bf-9e40-17c799ab516a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:09.361029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161fcd3-9ad1-48bf-9e40-17c799ab516a None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:09.410121 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 16/31] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:09.411045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161fcd3-9ad1-48bf-9e40-17c799ab516a None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:09.561262 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40565d99-7ff3-4292-b283-3620a98a1e24 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:09.590825 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:09.624680 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3a269-a045-49f9-b1ad-1274da659dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:09.625296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3a269-a045-49f9-b1ad-1274da659dc9 None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:09.625573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3a269-a045-49f9-b1ad-1274da659dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:09.625844 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3a269-a045-49f9-b1ad-1274da659dc9 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:09.627079 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3a269-a045-49f9-b1ad-1274da659dc9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:09.628480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3a269-a045-49f9-b1ad-1274da659dc9 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:09.630421 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161fcd3-9ad1-48bf-9e40-17c799ab516a None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:09.670122 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795e117-e9fe-40e9-adab-f3168d81ea71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:09.671137 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795e117-e9fe-40e9-adab-f3168d81ea71 None admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:09.671638 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795e117-e9fe-40e9-adab-f3168d81ea71 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:09.672111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795e117-e9fe-40e9-adab-f3168d81ea71 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:09.672989 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795e117-e9fe-40e9-adab-f3168d81ea71 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:09.674693 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795e117-e9fe-40e9-adab-f3168d81ea71 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:09.763373 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 16/32] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Aug 24 00:13:09 2022] POST /identity/v3/roles => generated 225 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:13:09.764335 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3a269-a045-49f9-b1ad-1274da659dc9 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:09.813204 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 17/33] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Aug 24 00:13:09 2022] POST /identity/v3/roles => generated 219 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:13:09.820944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795e117-e9fe-40e9-adab-f3168d81ea71 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:09.850571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:09.891941 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3a269-a045-49f9-b1ad-1274da659dc9 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:09.937956 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64160c3-f592-4ffb-9745-653b141d8d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:09.941343 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64160c3-f592-4ffb-9745-653b141d8d94 None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:09.942053 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64160c3-f592-4ffb-9745-653b141d8d94 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:09.943324 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64160c3-f592-4ffb-9745-653b141d8d94 None admin] PATH_INFO: `/v3/projects` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:09.944275 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64160c3-f592-4ffb-9745-653b141d8d94 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:09.949710 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64160c3-f592-4ffb-9745-653b141d8d94 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:09.997226 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 17/34] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 00:13:09 2022] POST /identity/v3/projects => generated 301 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:13:09.999316 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ea904-ec1d-4442-9a8f-5c6126dc8507 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:09.999639 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ea904-ec1d-4442-9a8f-5c6126dc8507 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:09.999930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ea904-ec1d-4442-9a8f-5c6126dc8507 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:10.006576 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 18/35] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:10.011404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0d8c4-26c8-4240-8193-da6810fbb302 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:10.011404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0d8c4-26c8-4240-8193-da6810fbb302 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:10.011404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0d8c4-26c8-4240-8193-da6810fbb302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:10.033075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-cce0d8c4-26c8-4240-8193-da6810fbb302 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:10.034888 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-cce0d8c4-26c8-4240-8193-da6810fbb302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:10.040147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795e117-e9fe-40e9-adab-f3168d81ea71 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:10.084529 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4704f-e143-43f6-bca9-26c571c04187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:10.086083 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4704f-e143-43f6-bca9-26c571c04187 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:10.086623 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4704f-e143-43f6-bca9-26c571c04187 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:10.088237 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4704f-e143-43f6-bca9-26c571c04187 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:10.097211 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:10.102115 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4704f-e143-43f6-bca9-26c571c04187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:10.109258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-98e4704f-e143-43f6-bca9-26c571c04187 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:13:10.109258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:10.109258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:10.109258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:10.109258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:10.109258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:10.109258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:10.109258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:10.109258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:10.109258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:10.109258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:10.109258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:10.109258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:10.109258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:10.109258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:10.109258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:10.110156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:10.110156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:10.110156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:10.110156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:10.110156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:10.110156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:10.110156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:10.110156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:10.110156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:10.110156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:10.110156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:10.110156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:10.110156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:10.110156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:10.110156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:10.110156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:10.115567 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:10.115567 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:10.115567 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:10.115567 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:10.115567 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:10.115567 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:10.115567 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:10.115567 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:10.115567 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:10.115567 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:10.115567 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:13:10.115567 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:10.115567 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 18/36] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 00:13:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:10.115567 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532cb7e-4871-4444-bcd0-0a93abe3e884 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:10.116288 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532cb7e-4871-4444-bcd0-0a93abe3e884 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:10.116288 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532cb7e-4871-4444-bcd0-0a93abe3e884 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:10.116288 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 19/37] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:10.122873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b729c93-45c5-4b1a-8df7-aae0e69a1d6b None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:10.123341 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b729c93-45c5-4b1a-8df7-aae0e69a1d6b None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:10.123627 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b729c93-45c5-4b1a-8df7-aae0e69a1d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:10.126807 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 19/38] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:10.131052 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0d8c4-26c8-4240-8193-da6810fbb302 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:10.159500 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-5b729c93-45c5-4b1a-8df7-aae0e69a1d6b None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:10.161310 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-5b729c93-45c5-4b1a-8df7-aae0e69a1d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:10.209440 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:10.253344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 20/39] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:10.274562 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0d8c4-26c8-4240-8193-da6810fbb302 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:10.313753 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777fe4c-783f-4518-8512-54ae01128a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:10.314432 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777fe4c-783f-4518-8512-54ae01128a2a None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:10.314676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777fe4c-783f-4518-8512-54ae01128a2a None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:10.314945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777fe4c-783f-4518-8512-54ae01128a2a None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:10.315777 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777fe4c-783f-4518-8512-54ae01128a2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:10.316355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777fe4c-783f-4518-8512-54ae01128a2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:10.317959 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777fe4c-783f-4518-8512-54ae01128a2a None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:10.333880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 20/40] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:10.339641 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b729c93-45c5-4b1a-8df7-aae0e69a1d6b None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:10.443779 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b729c93-45c5-4b1a-8df7-aae0e69a1d6b None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:10.472041 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:10.481362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b2a55-3192-4a43-a3ff-dd257fef491e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:10.482003 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b2a55-3192-4a43-a3ff-dd257fef491e None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:10.482286 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b2a55-3192-4a43-a3ff-dd257fef491e None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:10.482567 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b2a55-3192-4a43-a3ff-dd257fef491e None admin] PATH_INFO: `/v3/users/ba9622273acc4179a07cafb4c9699780` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:10.483742 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b2a55-3192-4a43-a3ff-dd257fef491e None admin] RBAC: Authorizing `identity:get_user(user_id=ba9622273acc4179a07cafb4c9699780)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:10.485335 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b2a55-3192-4a43-a3ff-dd257fef491e None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:10.487757 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 21/41] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:10 2022] GET /identity/v3/users/ba9622273acc4179a07cafb4c9699780 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:10.493048 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777fe4c-783f-4518-8512-54ae01128a2a None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:10.498288 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b2a55-3192-4a43-a3ff-dd257fef491e None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:10.606022 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777fe4c-783f-4518-8512-54ae01128a2a None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:10.610385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b2a55-3192-4a43-a3ff-dd257fef491e None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:10.620475 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:10.640805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40002301-2932-4648-b517-65662132787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:10.641426 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40002301-2932-4648-b517-65662132787c None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:10.641706 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40002301-2932-4648-b517-65662132787c None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:10.642500 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40002301-2932-4648-b517-65662132787c None admin] PATH_INFO: `/v3/domains/default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:10.643629 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40002301-2932-4648-b517-65662132787c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:10.645078 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40002301-2932-4648-b517-65662132787c None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:10.645441 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ecd25-9001-40b7-bad3-48bdc1723e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:10.646038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ecd25-9001-40b7-bad3-48bdc1723e83 None admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:10.646317 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ecd25-9001-40b7-bad3-48bdc1723e83 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:10.646597 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ecd25-9001-40b7-bad3-48bdc1723e83 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:10.646733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 21/42] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:13:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:10.647296 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ecd25-9001-40b7-bad3-48bdc1723e83 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:10.647406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40002301-2932-4648-b517-65662132787c None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:10.649082 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ecd25-9001-40b7-bad3-48bdc1723e83 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:10.664114 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 22/43] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Aug 24 00:13:10 2022] POST /identity/v3/roles => generated 223 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:13:10.667946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ecd25-9001-40b7-bad3-48bdc1723e83 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:10.734352 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:10.763652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40002301-2932-4648-b517-65662132787c None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:10.785601 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ecd25-9001-40b7-bad3-48bdc1723e83 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:10.803879 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7843c-f48c-4340-a477-5858ff6603bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:10.804801 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7843c-f48c-4340-a477-5858ff6603bf None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:10.805234 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7843c-f48c-4340-a477-5858ff6603bf None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:10.805669 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7843c-f48c-4340-a477-5858ff6603bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:10.807140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7843c-f48c-4340-a477-5858ff6603bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:10.808806 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7843c-f48c-4340-a477-5858ff6603bf None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:10.810614 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 22/44] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:13:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:10.817088 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7843c-f48c-4340-a477-5858ff6603bf None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:10.823122 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac7f7d-a17f-4532-9a67-55d30426c6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:10.823803 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac7f7d-a17f-4532-9a67-55d30426c6d7 None admin] REQUEST_METHOD: `PUT` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:10.824085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac7f7d-a17f-4532-9a67-55d30426c6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:10.824369 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac7f7d-a17f-4532-9a67-55d30426c6d7 None admin] PATH_INFO: `/v3/domains/default/users/ba9622273acc4179a07cafb4c9699780/roles/9b372d4fe82a4a54a3ecd29e7b912586` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:10.826387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac7f7d-a17f-4532-9a67-55d30426c6d7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ba9622273acc4179a07cafb4c9699780, role_id=9b372d4fe82a4a54a3ecd29e7b912586)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:10.828013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac7f7d-a17f-4532-9a67-55d30426c6d7 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:10.852039 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 23/45] 10.222.0.42 () {58 vars in 1361 bytes} [Wed Aug 24 00:13:10 2022] PUT /identity/v3/domains/default/users/ba9622273acc4179a07cafb4c9699780/roles/9b372d4fe82a4a54a3ecd29e7b912586 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:13:10.885761 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:10.944651 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7843c-f48c-4340-a477-5858ff6603bf None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:10.981237 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51896ce0-7221-4954-b695-2e06bfa9bd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:10.981859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51896ce0-7221-4954-b695-2e06bfa9bd6c None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:10.982140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51896ce0-7221-4954-b695-2e06bfa9bd6c None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:10.982415 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51896ce0-7221-4954-b695-2e06bfa9bd6c None admin] PATH_INFO: `/v3/projects` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:10.983127 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51896ce0-7221-4954-b695-2e06bfa9bd6c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:10.984691 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51896ce0-7221-4954-b695-2e06bfa9bd6c None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:11.013329 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 00:13:10 2022] POST /identity/v3/projects => generated 312 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:13:13.038421 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ccfc0-e4e9-42b7-93a0-5367596fe01e None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:13.039025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ccfc0-e4e9-42b7-93a0-5367596fe01e None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:13.039025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ccfc0-e4e9-42b7-93a0-5367596fe01e None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:13.040469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 24/47] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:13.046910 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308fbf0-adbc-4d06-9f1a-0c42c44d84a9 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:13.047462 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308fbf0-adbc-4d06-9f1a-0c42c44d84a9 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:13.047570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308fbf0-adbc-4d06-9f1a-0c42c44d84a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:13.067503 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-8308fbf0-adbc-4d06-9f1a-0c42c44d84a9 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:13.068712 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-8308fbf0-adbc-4d06-9f1a-0c42c44d84a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:13.137205 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 24/48] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:13.198961 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1f390-46e0-42cd-9ca2-8ebfdf039a52 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:13.199281 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1f390-46e0-42cd-9ca2-8ebfdf039a52 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:13.199566 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1f390-46e0-42cd-9ca2-8ebfdf039a52 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:13.200925 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 25/49] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:13.208270 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ed58d-c5ad-4803-a484-996cedc61964 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:13.208501 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ed58d-c5ad-4803-a484-996cedc61964 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:13.208778 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ed58d-c5ad-4803-a484-996cedc61964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:13.226561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-1f7ed58d-c5ad-4803-a484-996cedc61964 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:13.227776 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-1f7ed58d-c5ad-4803-a484-996cedc61964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:13.254315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:13.297625 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 25/50] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:13.470533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1f390-46e0-42cd-9ca2-8ebfdf039a52 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:13.573739 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1f390-46e0-42cd-9ca2-8ebfdf039a52 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:13.589785 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:13.608526 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34a6ad-85c7-4498-90db-ebcfb0fafe7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:13.609158 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34a6ad-85c7-4498-90db-ebcfb0fafe7f None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:13.609447 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34a6ad-85c7-4498-90db-ebcfb0fafe7f None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:13.609721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34a6ad-85c7-4498-90db-ebcfb0fafe7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:13.620660 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34a6ad-85c7-4498-90db-ebcfb0fafe7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:13.622691 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ed58d-c5ad-4803-a484-996cedc61964 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:13.626479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-fa34a6ad-85c7-4498-90db-ebcfb0fafe7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:13:13.626479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:13.626479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:13.626479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:13.626479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:13.626479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:13.626479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:13.626479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:13.626479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:13.626479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:13.626479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:13.626479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:13.626479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:13.626479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:13.626479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:13.626479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:13.627523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:13.627523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:13.627523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:13.627523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:13.627523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:13.627523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:13.627523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:13.627523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:13.627523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:13.627523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:13.627523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:13.627523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:13.627523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:13.627523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:13.627523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:13.627523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:13.628595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:13.628595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:13.628595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:13.628595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:13.628595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:13.628595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:13.628595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:13.628595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:13.628595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:13.628595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:13.628595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:13:13.628595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:13.628595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 26/51] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 00:13:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:13.632445 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34a6ad-85c7-4498-90db-ebcfb0fafe7f None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:13.722112 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ed58d-c5ad-4803-a484-996cedc61964 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:13.734312 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34a6ad-85c7-4498-90db-ebcfb0fafe7f None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:13.755622 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd1d71-9817-4ea6-a686-f9bbfc99cbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:13.756263 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd1d71-9817-4ea6-a686-f9bbfc99cbce None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:13.756555 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd1d71-9817-4ea6-a686-f9bbfc99cbce None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:13.756838 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd1d71-9817-4ea6-a686-f9bbfc99cbce None admin] PATH_INFO: `/v3/domains/default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:13.757979 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd1d71-9817-4ea6-a686-f9bbfc99cbce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:13.759466 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd1d71-9817-4ea6-a686-f9bbfc99cbce None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:13.761047 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 26/52] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:13:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:13.766486 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd1d71-9817-4ea6-a686-f9bbfc99cbce None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:13.768644 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74d4a1-36ed-466c-b71b-ae25eb9fd252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:13.769255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74d4a1-36ed-466c-b71b-ae25eb9fd252 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:13.769711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74d4a1-36ed-466c-b71b-ae25eb9fd252 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:13.769989 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74d4a1-36ed-466c-b71b-ae25eb9fd252 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:13.770661 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74d4a1-36ed-466c-b71b-ae25eb9fd252 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:13.770965 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74d4a1-36ed-466c-b71b-ae25eb9fd252 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:13.772429 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74d4a1-36ed-466c-b71b-ae25eb9fd252 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:13.780717 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 27/53] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:13.786870 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74d4a1-36ed-466c-b71b-ae25eb9fd252 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:13.799050 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:13.827133 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:13.870043 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd1d71-9817-4ea6-a686-f9bbfc99cbce None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:13.890378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74d4a1-36ed-466c-b71b-ae25eb9fd252 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:13.908602 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55173158-1402-4471-9930-8b610865eae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:13.909209 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55173158-1402-4471-9930-8b610865eae8 None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:13.909487 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55173158-1402-4471-9930-8b610865eae8 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:13.909762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55173158-1402-4471-9930-8b610865eae8 None admin] PATH_INFO: `/v3/projects` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:13.910431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55173158-1402-4471-9930-8b610865eae8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:13.911941 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55173158-1402-4471-9930-8b610865eae8 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:13.925138 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24936c0-6ee5-4433-9052-620b84d58728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:13.925772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24936c0-6ee5-4433-9052-620b84d58728 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:13.926060 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24936c0-6ee5-4433-9052-620b84d58728 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:13.926339 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24936c0-6ee5-4433-9052-620b84d58728 None admin] PATH_INFO: `/v3/users/ba9622273acc4179a07cafb4c9699780` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:13.927548 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24936c0-6ee5-4433-9052-620b84d58728 None admin] RBAC: Authorizing `identity:get_user(user_id=ba9622273acc4179a07cafb4c9699780)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:13.929064 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24936c0-6ee5-4433-9052-620b84d58728 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:13.930774 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 28/54] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:13 2022] GET /identity/v3/users/ba9622273acc4179a07cafb4c9699780 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:13.936305 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24936c0-6ee5-4433-9052-620b84d58728 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:13.947042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 27/55] 10.222.0.42 () {60 vars in 1140 bytes} [Wed Aug 24 00:13:13 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:13:14.055807 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24936c0-6ee5-4433-9052-620b84d58728 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:14.066360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:14.095850 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60352e61-e71f-461e-b1d8-94a88725f92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:14.096406 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352e61-e71f-461e-b1d8-94a88725f92c None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:14.096694 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352e61-e71f-461e-b1d8-94a88725f92c None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:14.096973 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352e61-e71f-461e-b1d8-94a88725f92c None admin] PATH_INFO: `/v3/domains/default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:14.098148 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60352e61-e71f-461e-b1d8-94a88725f92c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:14.099673 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60352e61-e71f-461e-b1d8-94a88725f92c None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:14.101298 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 29/56] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:13:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:14.107492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55173158-1402-4471-9930-8b610865eae8 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:14.193015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:14.214065 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55173158-1402-4471-9930-8b610865eae8 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:14.247997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a94326-da85-4d78-b829-6ca7707be0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:14.248605 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a94326-da85-4d78-b829-6ca7707be0f5 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:14.248890 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a94326-da85-4d78-b829-6ca7707be0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:14.249170 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a94326-da85-4d78-b829-6ca7707be0f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:14.249902 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a94326-da85-4d78-b829-6ca7707be0f5 None admin] RBAC: Adding query filter params (role.id=9b372d4fe82a4a54a3ecd29e7b912586, scope.domain.id=default, user.id=ba9622273acc4179a07cafb4c9699780) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:14.250216 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a94326-da85-4d78-b829-6ca7707be0f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:14.252239 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a94326-da85-4d78-b829-6ca7707be0f5 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:14.258104 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1322 bytes} [Wed Aug 24 00:13:14 2022] GET /identity/v3/role_assignments?user.id=ba9622273acc4179a07cafb4c9699780&scope.domain.id=default&role.id=9b372d4fe82a4a54a3ecd29e7b912586 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:16.151634 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1426637-ac86-47d0-a5e6-a7d0ed8eef1a None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:16.152151 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1426637-ac86-47d0-a5e6-a7d0ed8eef1a None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:16.152257 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1426637-ac86-47d0-a5e6-a7d0ed8eef1a None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:16.153546 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 30/58] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:16.159589 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e7a30-7457-4fab-8d32-c71bdb2271a7 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:16.160014 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e7a30-7457-4fab-8d32-c71bdb2271a7 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:16.160151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e7a30-7457-4fab-8d32-c71bdb2271a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:16.177855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-a35e7a30-7457-4fab-8d32-c71bdb2271a7 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:16.179045 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-a35e7a30-7457-4fab-8d32-c71bdb2271a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:16.243194 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 29/59] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:16.571724 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1426637-ac86-47d0-a5e6-a7d0ed8eef1a None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:16.671047 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1426637-ac86-47d0-a5e6-a7d0ed8eef1a None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:16.704564 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ec689-e1ac-49fb-8f82-598d56863c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:16.705175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ec689-e1ac-49fb-8f82-598d56863c2c None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:16.705459 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ec689-e1ac-49fb-8f82-598d56863c2c None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:16.705736 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ec689-e1ac-49fb-8f82-598d56863c2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:16.706867 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ec689-e1ac-49fb-8f82-598d56863c2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:16.708352 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ec689-e1ac-49fb-8f82-598d56863c2c None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:16.709897 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 31/60] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:13:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:16.715625 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e7a30-7457-4fab-8d32-c71bdb2271a7 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:16.790331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:16.813254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e7a30-7457-4fab-8d32-c71bdb2271a7 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:16.847906 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c73a02-9844-4da6-9507-96be0315e1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:16.849810 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c73a02-9844-4da6-9507-96be0315e1c1 None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:16.850097 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c73a02-9844-4da6-9507-96be0315e1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:16.850374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c73a02-9844-4da6-9507-96be0315e1c1 None admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:16.851044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c73a02-9844-4da6-9507-96be0315e1c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:16.852513 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c73a02-9844-4da6-9507-96be0315e1c1 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:16.882420 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 30/61] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 00:13:16 2022] POST /identity/v3/users => generated 275 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:13:20.255975 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed78c3-179d-4f12-b46a-1fe11e7ecb3a None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:20.256525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed78c3-179d-4f12-b46a-1fe11e7ecb3a None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:20.256716 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed78c3-179d-4f12-b46a-1fe11e7ecb3a None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:20.259058 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 32/62] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:20.274593 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feab393-6180-471f-b0de-1ebe1c8be17e None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:20.275484 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feab393-6180-471f-b0de-1ebe1c8be17e None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:20.275905 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feab393-6180-471f-b0de-1ebe1c8be17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:20.304018 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-1feab393-6180-471f-b0de-1ebe1c8be17e None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:20.305474 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-1feab393-6180-471f-b0de-1ebe1c8be17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:20.396722 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 31/63] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:20.398437 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299650d-d2d5-4671-b297-6414629664a4 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:20.398883 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299650d-d2d5-4671-b297-6414629664a4 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:20.399315 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299650d-d2d5-4671-b297-6414629664a4 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:20.400771 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 33/64] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:20.406338 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fca1c8-dd89-44b7-a44f-0d4cf3130515 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:20.406782 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fca1c8-dd89-44b7-a44f-0d4cf3130515 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:20.407222 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fca1c8-dd89-44b7-a44f-0d4cf3130515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:20.432334 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-e4fca1c8-dd89-44b7-a44f-0d4cf3130515 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:20.433816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-e4fca1c8-dd89-44b7-a44f-0d4cf3130515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:20.436668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3c432-3e01-4210-b9ab-9298d60a5927 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:20.437218 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3c432-3e01-4210-b9ab-9298d60a5927 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:20.437734 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3c432-3e01-4210-b9ab-9298d60a5927 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:20.440266 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 32/65] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:13:20.448390 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806f43b-1066-4a6f-81da-37e0e03a92da None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:20.448900 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806f43b-1066-4a6f-81da-37e0e03a92da None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:20.449314 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806f43b-1066-4a6f-81da-37e0e03a92da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:20.476935 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-0806f43b-1066-4a6f-81da-37e0e03a92da None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:20.481122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-0806f43b-1066-4a6f-81da-37e0e03a92da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:20.521884 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:20.589227 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 34/66] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:13:20.597009 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:20.612919 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 33/67] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:20.761132 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fca1c8-dd89-44b7-a44f-0d4cf3130515 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:20.888469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fca1c8-dd89-44b7-a44f-0d4cf3130515 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:20.930715 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25c935-c628-4b13-81e9-3e21e1a0f9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:20.931729 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25c935-c628-4b13-81e9-3e21e1a0f9ca None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:20.932229 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25c935-c628-4b13-81e9-3e21e1a0f9ca None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:20.932696 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25c935-c628-4b13-81e9-3e21e1a0f9ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:20.949215 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25c935-c628-4b13-81e9-3e21e1a0f9ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:20.954600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-0a25c935-c628-4b13-81e9-3e21e1a0f9ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:20.954600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:20.954600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:20.954600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:20.954600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:20.954600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:20.954600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:20.954600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:20.954600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:20.954600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:20.954600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:20.954600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:20.954600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:20.954600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:20.954600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:20.954600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:20.955629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:20.955629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:20.955629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:20.955629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:20.955629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:20.955629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:20.955629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:20.955629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:20.955629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:20.955629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:20.955629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:20.955629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:20.955629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:20.955629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:20.955629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:20.955629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:20.956395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:20.956395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:20.956395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:20.956395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:20.956395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:20.956395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:20.956395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:20.956395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:20.956395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:20.956395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:20.956395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:20.956395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:20.958926 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 35/68] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:20.965067 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806f43b-1066-4a6f-81da-37e0e03a92da None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:21.007970 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25c935-c628-4b13-81e9-3e21e1a0f9ca None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:21.045735 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:21.104595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806f43b-1066-4a6f-81da-37e0e03a92da None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:21.121973 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25c935-c628-4b13-81e9-3e21e1a0f9ca None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:21.140625 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3f41b-1355-43a1-8c88-e5562449a1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:21.141167 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3f41b-1355-43a1-8c88-e5562449a1ff None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:21.141448 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3f41b-1355-43a1-8c88-e5562449a1ff None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:21.141722 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3f41b-1355-43a1-8c88-e5562449a1ff None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:21.142914 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3f41b-1355-43a1-8c88-e5562449a1ff None admin] RBAC: Adding query filter params (name=member) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:21.143251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3f41b-1355-43a1-8c88-e5562449a1ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:21.144643 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3f41b-1355-43a1-8c88-e5562449a1ff None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:21.153042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:21.154273 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e24d4e-6806-40e4-a24f-81f6bc2d0291 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:21.154560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e24d4e-6806-40e4-a24f-81f6bc2d0291 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:21.154828 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e24d4e-6806-40e4-a24f-81f6bc2d0291 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:21.156288 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 35/70] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:21.156801 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e24d4e-6806-40e4-a24f-81f6bc2d0291 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:21.159238 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb29bd-2720-4d96-af23-7e5e4e76ec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:21.159868 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb29bd-2720-4d96-af23-7e5e4e76ec44 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:21.160154 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb29bd-2720-4d96-af23-7e5e4e76ec44 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:21.160429 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb29bd-2720-4d96-af23-7e5e4e76ec44 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:21.171591 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb29bd-2720-4d96-af23-7e5e4e76ec44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:21.176368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-8dcb29bd-2720-4d96-af23-7e5e4e76ec44 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:13:21.176368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:21.176368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:21.176368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:21.176368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:21.176368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:21.176368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:21.176368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:21.176368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:21.176368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:21.176368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:21.176368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:21.176368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:21.176368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:21.176368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:21.176368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:21.177214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:21.177214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:21.177214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:21.177214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:21.177214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:21.177214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:21.177214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:21.177214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:21.177214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:21.177214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:21.177214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:21.177214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:21.177214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:21.177214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:21.177214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:21.177214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:21.177971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:21.177971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:21.177971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:21.177971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:21.177971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:21.177971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:21.177971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:21.177971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:21.177971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:21.177971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:21.177971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:13:21.177971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:21.177971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 36/71] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:13:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:13:21.179101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a436658-85ce-4105-8f8d-d0dc7bd235f9 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:21.179101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a436658-85ce-4105-8f8d-d0dc7bd235f9 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:21.179243 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a436658-85ce-4105-8f8d-d0dc7bd235f9 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:21.180487 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 37/72] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:21.181600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a436658-85ce-4105-8f8d-d0dc7bd235f9 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:21.217952 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:21.263851 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e24d4e-6806-40e4-a24f-81f6bc2d0291 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:21.275312 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:21.285946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a436658-85ce-4105-8f8d-d0dc7bd235f9 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:21.297726 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ffad3-50f0-4f34-9986-c8a25bb0ac13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:21.298360 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ffad3-50f0-4f34-9986-c8a25bb0ac13 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:21.298685 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ffad3-50f0-4f34-9986-c8a25bb0ac13 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:21.298969 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ffad3-50f0-4f34-9986-c8a25bb0ac13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:21.310575 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ffad3-50f0-4f34-9986-c8a25bb0ac13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:21.316920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-d73ffad3-50f0-4f34-9986-c8a25bb0ac13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:13:21.316920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:21.316920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:21.316920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:21.316920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:21.316920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:21.316920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:21.316920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:21.316920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:21.316920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:21.316920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:21.316920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:21.316920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:21.316920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:21.316920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:21.316920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:21.317762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:21.317762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:21.317762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:21.317762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:21.317762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:21.317762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:21.317762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:21.317762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:21.317762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:21.317762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:21.317762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:21.317762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:21.317762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:21.317762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:21.317762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:21.317762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:21.318525 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:21.318525 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:21.318525 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:21.318525 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:21.318525 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:21.318525 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:21.318525 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:21.318525 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:21.318525 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:21.318525 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:21.318525 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:13:21.318525 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:13:21.318525 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 00:13:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:21.319180 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239334b-8980-4b7e-8f44-d7afcaa37e5b None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:21.319866 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239334b-8980-4b7e-8f44-d7afcaa37e5b None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:21.319866 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239334b-8980-4b7e-8f44-d7afcaa37e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:21.322878 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c05f1-ef83-40ed-85f4-32cf6e6b749e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:21.323543 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c05f1-ef83-40ed-85f4-32cf6e6b749e None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:21.323826 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c05f1-ef83-40ed-85f4-32cf6e6b749e None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:21.324103 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c05f1-ef83-40ed-85f4-32cf6e6b749e None admin] PATH_INFO: `/v3/users/7ff34784d9634d5bb6512d1ca036719d` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:21.339389 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-b239334b-8980-4b7e-8f44-d7afcaa37e5b None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:21.340384 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c05f1-ef83-40ed-85f4-32cf6e6b749e None admin] RBAC: Authorizing `identity:get_user(user_id=7ff34784d9634d5bb6512d1ca036719d)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:21.341380 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-b239334b-8980-4b7e-8f44-d7afcaa37e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:21.342069 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c05f1-ef83-40ed-85f4-32cf6e6b749e None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:21.343577 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 38/74] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:21 2022] GET /identity/v3/users/7ff34784d9634d5bb6512d1ca036719d => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:21.344459 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c05f1-ef83-40ed-85f4-32cf6e6b749e None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:21.417033 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 37/75] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:21.418201 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90dd695-71d8-45fb-865a-88382d9d1adb None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:21.418494 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90dd695-71d8-45fb-865a-88382d9d1adb None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:21.418771 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90dd695-71d8-45fb-865a-88382d9d1adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:21.446395 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-f90dd695-71d8-45fb-865a-88382d9d1adb None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:21.447636 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-f90dd695-71d8-45fb-865a-88382d9d1adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:21.449711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c05f1-ef83-40ed-85f4-32cf6e6b749e None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:21.488283 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198d920-0af0-4062-8d0d-5eaf0250fc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:21.488996 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198d920-0af0-4062-8d0d-5eaf0250fc95 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:21.489350 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198d920-0af0-4062-8d0d-5eaf0250fc95 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:21.489699 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198d920-0af0-4062-8d0d-5eaf0250fc95 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:21.490433 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198d920-0af0-4062-8d0d-5eaf0250fc95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:21.490814 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198d920-0af0-4062-8d0d-5eaf0250fc95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:21.491748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:21.492382 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198d920-0af0-4062-8d0d-5eaf0250fc95 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:21.501784 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 39/76] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:13:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:21.507275 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198d920-0af0-4062-8d0d-5eaf0250fc95 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:21.521174 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 38/77] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:21.523921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90dd695-71d8-45fb-865a-88382d9d1adb None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:21.548300 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:21.635371 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90dd695-71d8-45fb-865a-88382d9d1adb None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:21.658582 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198d920-0af0-4062-8d0d-5eaf0250fc95 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:21.670670 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1abbc-07bf-4996-8278-4009f3beeaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:21.671587 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1abbc-07bf-4996-8278-4009f3beeaac None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:21.672068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1abbc-07bf-4996-8278-4009f3beeaac None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:21.672549 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1abbc-07bf-4996-8278-4009f3beeaac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:21.697837 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832d3d7-936e-467f-b3e5-0e1eeb19f4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:21.698815 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832d3d7-936e-467f-b3e5-0e1eeb19f4b8 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:21.699317 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832d3d7-936e-467f-b3e5-0e1eeb19f4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:21.699857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832d3d7-936e-467f-b3e5-0e1eeb19f4b8 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:21.700793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832d3d7-936e-467f-b3e5-0e1eeb19f4b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:21.701297 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832d3d7-936e-467f-b3e5-0e1eeb19f4b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:21.703073 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832d3d7-936e-467f-b3e5-0e1eeb19f4b8 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:21.713097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 40/78] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:21.714171 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832d3d7-936e-467f-b3e5-0e1eeb19f4b8 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:21.719614 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:21.745221 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1abbc-07bf-4996-8278-4009f3beeaac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:21.746688 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1abbc-07bf-4996-8278-4009f3beeaac None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:21.796150 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:21.823528 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832d3d7-936e-467f-b3e5-0e1eeb19f4b8 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:21.855359 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 39/79] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:13:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:13:21.856489 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1abbc-07bf-4996-8278-4009f3beeaac None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:21.862923 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635ad7c-7b33-4fd0-bda8-b5114c634ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:21.863574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635ad7c-7b33-4fd0-bda8-b5114c634ec3 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:21.863856 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635ad7c-7b33-4fd0-bda8-b5114c634ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:21.864131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635ad7c-7b33-4fd0-bda8-b5114c634ec3 None admin] PATH_INFO: `/v3/users/7ff34784d9634d5bb6512d1ca036719d` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:21.865273 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635ad7c-7b33-4fd0-bda8-b5114c634ec3 None admin] RBAC: Authorizing `identity:get_user(user_id=7ff34784d9634d5bb6512d1ca036719d)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:21.866738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635ad7c-7b33-4fd0-bda8-b5114c634ec3 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:21.868344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 41/80] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:21 2022] GET /identity/v3/users/7ff34784d9634d5bb6512d1ca036719d => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:21.869100 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635ad7c-7b33-4fd0-bda8-b5114c634ec3 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:21.932147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:21.957661 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1abbc-07bf-4996-8278-4009f3beeaac None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:21.967832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635ad7c-7b33-4fd0-bda8-b5114c634ec3 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:21.991639 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0ae83-204d-463e-84fe-fc479c6d083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:21.992195 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0ae83-204d-463e-84fe-fc479c6d083e None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:21.992473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0ae83-204d-463e-84fe-fc479c6d083e None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:21.992745 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0ae83-204d-463e-84fe-fc479c6d083e None admin] PATH_INFO: `/v3/users/ba9622273acc4179a07cafb4c9699780` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:21.993893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0ae83-204d-463e-84fe-fc479c6d083e None admin] RBAC: Authorizing `identity:get_user(user_id=ba9622273acc4179a07cafb4c9699780)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:21.995364 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0ae83-204d-463e-84fe-fc479c6d083e None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:21.996928 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 40/81] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:21 2022] GET /identity/v3/users/ba9622273acc4179a07cafb4c9699780 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:21.997718 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0ae83-204d-463e-84fe-fc479c6d083e None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:22.005809 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8f9b3-f6fb-4861-831c-31a9f5569d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:22.006451 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8f9b3-f6fb-4861-831c-31a9f5569d7c None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:22.006754 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8f9b3-f6fb-4861-831c-31a9f5569d7c None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:22.007048 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8f9b3-f6fb-4861-831c-31a9f5569d7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:22.008190 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8f9b3-f6fb-4861-831c-31a9f5569d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:22.009656 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8f9b3-f6fb-4861-831c-31a9f5569d7c None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:22.011343 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 42/82] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:13:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:22.012107 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8f9b3-f6fb-4861-831c-31a9f5569d7c None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:22.024831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:22.100573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0ae83-204d-463e-84fe-fc479c6d083e None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:22.111659 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8f9b3-f6fb-4861-831c-31a9f5569d7c None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:22.134590 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb14e8c-d7ba-4972-bb60-bc75bfccb145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:22.135260 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb14e8c-d7ba-4972-bb60-bc75bfccb145 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:22.135546 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb14e8c-d7ba-4972-bb60-bc75bfccb145 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:22.135816 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb14e8c-d7ba-4972-bb60-bc75bfccb145 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:22.144752 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8199a-b832-48ec-b7e1-00e8d0bd0312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:22.145376 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8199a-b832-48ec-b7e1-00e8d0bd0312 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:22.145664 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8199a-b832-48ec-b7e1-00e8d0bd0312 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:22.145931 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb14e8c-d7ba-4972-bb60-bc75bfccb145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:22.146020 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8199a-b832-48ec-b7e1-00e8d0bd0312 None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:22.147096 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8199a-b832-48ec-b7e1-00e8d0bd0312 None admin] RBAC: Authorizing `identity:get_project(project_id=10ae72b6264047109854b2e9468e9ba3)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:22.148565 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8199a-b832-48ec-b7e1-00e8d0bd0312 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:22.150203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 43/83] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:22 2022] GET /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:22.151292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-5fb14e8c-d7ba-4972-bb60-bc75bfccb145 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:22.151292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:22.151292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:22.151292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:22.151292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:22.151292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:22.151292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:22.151292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:22.151292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:22.151292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:22.151292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:22.151292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:22.151292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:22.151292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:22.151292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:22.151292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:22.152168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:22.152168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:22.152168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:22.152168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:22.152168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:22.152168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:22.152168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:22.152168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:22.152168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:22.152168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:22.152168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:22.152168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:22.152168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:22.152168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:22.152168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:22.152168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:22.152926 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:22.152926 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:22.152926 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:22.152926 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:22.152926 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:22.152926 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:22.152926 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:22.152926 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:22.152926 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:22.152926 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:22.152926 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:22.152926 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:13:22.153524 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8199a-b832-48ec-b7e1-00e8d0bd0312 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:22.153598 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 41/84] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:22.154150 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb14e8c-d7ba-4972-bb60-bc75bfccb145 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:22.157912 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:22.234008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:22.255359 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb14e8c-d7ba-4972-bb60-bc75bfccb145 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:22.255865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8199a-b832-48ec-b7e1-00e8d0bd0312 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:22.289185 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdd974-9e02-4c5c-95e3-9c33bfb24a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:22.289374 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f5bec-4c68-4025-860e-e903fc22ecfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:22.289810 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdd974-9e02-4c5c-95e3-9c33bfb24a17 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:22.289887 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f5bec-4c68-4025-860e-e903fc22ecfb None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:22.290131 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdd974-9e02-4c5c-95e3-9c33bfb24a17 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:22.290267 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f5bec-4c68-4025-860e-e903fc22ecfb None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:22.290338 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f5bec-4c68-4025-860e-e903fc22ecfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:22.290402 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdd974-9e02-4c5c-95e3-9c33bfb24a17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:22.358707 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f5bec-4c68-4025-860e-e903fc22ecfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:22.359823 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f5bec-4c68-4025-860e-e903fc22ecfb None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:22.361365 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdd974-9e02-4c5c-95e3-9c33bfb24a17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:22.362837 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdd974-9e02-4c5c-95e3-9c33bfb24a17 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:22.364718 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:22.437565 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:22.460276 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 44/85] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:13:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:13:22.460505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 42/86] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:13:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:13:22.461093 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f5bec-4c68-4025-860e-e903fc22ecfb None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:22.461646 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdd974-9e02-4c5c-95e3-9c33bfb24a17 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:22.563914 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdd974-9e02-4c5c-95e3-9c33bfb24a17 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:22.564096 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f5bec-4c68-4025-860e-e903fc22ecfb None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:22.565560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:22.598533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb051b-f8fb-4739-939d-54195d70c89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:22.599180 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb051b-f8fb-4739-939d-54195d70c89c None admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:22.599469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb051b-f8fb-4739-939d-54195d70c89c None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:22.599579 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1359f3-3f97-4de7-ba28-5d16ae1229cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:22.599749 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb051b-f8fb-4739-939d-54195d70c89c None admin] PATH_INFO: `/v3/users` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:22.600256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1359f3-3f97-4de7-ba28-5d16ae1229cd None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:22.600397 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb051b-f8fb-4739-939d-54195d70c89c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:22.600536 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1359f3-3f97-4de7-ba28-5d16ae1229cd None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:22.600808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1359f3-3f97-4de7-ba28-5d16ae1229cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:22.601770 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1359f3-3f97-4de7-ba28-5d16ae1229cd None admin] RBAC: Adding query filter params (role.id=3fe3a1eb546b456aa3c8bce846a8d37f, scope.project.id=10ae72b6264047109854b2e9468e9ba3, user.id=7ff34784d9634d5bb6512d1ca036719d) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:22.601874 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb051b-f8fb-4739-939d-54195d70c89c None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:22.602955 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1359f3-3f97-4de7-ba28-5d16ae1229cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:22.603963 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1359f3-3f97-4de7-ba28-5d16ae1229cd None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:22.609615 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 43/87] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:13:22 2022] GET /identity/v3/role_assignments?user.id=7ff34784d9634d5bb6512d1ca036719d&scope.project.id=10ae72b6264047109854b2e9468e9ba3&role.id=3fe3a1eb546b456aa3c8bce846a8d37f => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:22.610502 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1359f3-3f97-4de7-ba28-5d16ae1229cd None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:22.643039 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 45/88] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 00:13:22 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:13:22.643039 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb051b-f8fb-4739-939d-54195d70c89c None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:22.709856 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:22.746956 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1359f3-3f97-4de7-ba28-5d16ae1229cd None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:22.787134 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22844323-e5e4-4b09-8104-858818af6141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:22.788110 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22844323-e5e4-4b09-8104-858818af6141 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:22.788537 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22844323-e5e4-4b09-8104-858818af6141 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:22.788957 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22844323-e5e4-4b09-8104-858818af6141 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:22.789880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22844323-e5e4-4b09-8104-858818af6141 None admin] RBAC: Adding query filter params (name=member) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:22.790409 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22844323-e5e4-4b09-8104-858818af6141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:22.792020 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22844323-e5e4-4b09-8104-858818af6141 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:22.801726 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 44/89] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:22.802858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22844323-e5e4-4b09-8104-858818af6141 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:22.846895 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb051b-f8fb-4739-939d-54195d70c89c None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:22.847116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:22.905285 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db40a1-b9a4-4c48-bd0b-72874c1130bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:22.905968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db40a1-b9a4-4c48-bd0b-72874c1130bc None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:22.906256 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db40a1-b9a4-4c48-bd0b-72874c1130bc None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:22.906537 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db40a1-b9a4-4c48-bd0b-72874c1130bc None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:22.908643 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db40a1-b9a4-4c48-bd0b-72874c1130bc None admin] RBAC: Authorizing `identity:get_project(project_id=10ae72b6264047109854b2e9468e9ba3)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:22.911047 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db40a1-b9a4-4c48-bd0b-72874c1130bc None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:22.913413 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 46/90] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:22 2022] GET /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:22.914629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db40a1-b9a4-4c48-bd0b-72874c1130bc None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:22.960170 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22844323-e5e4-4b09-8104-858818af6141 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:22.998516 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f85d65-128d-41b9-9e70-b72a99119ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:22.999248 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f85d65-128d-41b9-9e70-b72a99119ae7 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:22.999530 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f85d65-128d-41b9-9e70-b72a99119ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:22.999800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f85d65-128d-41b9-9e70-b72a99119ae7 None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:23.002018 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f85d65-128d-41b9-9e70-b72a99119ae7 None admin] RBAC: Authorizing `identity:get_project(project_id=10ae72b6264047109854b2e9468e9ba3)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:23.003245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f85d65-128d-41b9-9e70-b72a99119ae7 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:23.005435 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 45/91] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:22 2022] GET /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:23.006150 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f85d65-128d-41b9-9e70-b72a99119ae7 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:23.048995 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db40a1-b9a4-4c48-bd0b-72874c1130bc None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:23.057182 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:23.096310 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c775c4-338d-4136-a17b-b6f434fbf200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:23.096664 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c775c4-338d-4136-a17b-b6f434fbf200 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:23.096899 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c775c4-338d-4136-a17b-b6f434fbf200 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:23.097170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c775c4-338d-4136-a17b-b6f434fbf200 None admin] PATH_INFO: `/v3/users/7ff34784d9634d5bb6512d1ca036719d` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:23.099987 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c775c4-338d-4136-a17b-b6f434fbf200 None admin] RBAC: Authorizing `identity:get_user(user_id=7ff34784d9634d5bb6512d1ca036719d)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:23.102156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c775c4-338d-4136-a17b-b6f434fbf200 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:23.104808 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 47/92] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:22 2022] GET /identity/v3/users/7ff34784d9634d5bb6512d1ca036719d => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:23.104808 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c775c4-338d-4136-a17b-b6f434fbf200 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:23.124051 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:23.130500 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f85d65-128d-41b9-9e70-b72a99119ae7 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:23.180466 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f765-a48b-42c5-8994-db715c210e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:23.181118 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f765-a48b-42c5-8994-db715c210e86 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:23.181487 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f765-a48b-42c5-8994-db715c210e86 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:23.181766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f765-a48b-42c5-8994-db715c210e86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:23.182629 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932f765-a48b-42c5-8994-db715c210e86 None admin] RBAC: Adding query filter params (role.id=9b372d4fe82a4a54a3ecd29e7b912586, scope.project.id=10ae72b6264047109854b2e9468e9ba3, user.id=ba9622273acc4179a07cafb4c9699780) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:23.182942 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932f765-a48b-42c5-8994-db715c210e86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:23.184458 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932f765-a48b-42c5-8994-db715c210e86 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:23.193367 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 46/93] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:13:23 2022] GET /identity/v3/role_assignments?user.id=ba9622273acc4179a07cafb4c9699780&scope.project.id=10ae72b6264047109854b2e9468e9ba3&role.id=9b372d4fe82a4a54a3ecd29e7b912586 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:23.194423 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f765-a48b-42c5-8994-db715c210e86 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:23.237033 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c775c4-338d-4136-a17b-b6f434fbf200 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:23.289745 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4620d-aa3d-456f-bcc2-7fc2b603fce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:23.290543 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4620d-aa3d-456f-bcc2-7fc2b603fce5 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:23.290829 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4620d-aa3d-456f-bcc2-7fc2b603fce5 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:23.292077 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4620d-aa3d-456f-bcc2-7fc2b603fce5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:23.292832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4620d-aa3d-456f-bcc2-7fc2b603fce5 None admin] RBAC: Adding query filter params (role.id=a7db20dbcb4b458d932c564bc9ad5bfb, scope.project.id=10ae72b6264047109854b2e9468e9ba3, user.id=7ff34784d9634d5bb6512d1ca036719d) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:23.293150 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4620d-aa3d-456f-bcc2-7fc2b603fce5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:23.294628 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4620d-aa3d-456f-bcc2-7fc2b603fce5 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:23.308012 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 48/94] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:13:23 2022] GET /identity/v3/role_assignments?user.id=7ff34784d9634d5bb6512d1ca036719d&scope.project.id=10ae72b6264047109854b2e9468e9ba3&role.id=a7db20dbcb4b458d932c564bc9ad5bfb => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:23.335175 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f765-a48b-42c5-8994-db715c210e86 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:23.375190 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23ec16-84d1-4c15-b06d-8c3e4abe84c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:23.375887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23ec16-84d1-4c15-b06d-8c3e4abe84c1 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:23.376226 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23ec16-84d1-4c15-b06d-8c3e4abe84c1 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:23.377094 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23ec16-84d1-4c15-b06d-8c3e4abe84c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:23.416282 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:23.473947 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23ec16-84d1-4c15-b06d-8c3e4abe84c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:23.475505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23ec16-84d1-4c15-b06d-8c3e4abe84c1 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:23.620602 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 47/95] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:13:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:13:23.626952 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4620d-aa3d-456f-bcc2-7fc2b603fce5 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:23.666069 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:23.738752 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4620d-aa3d-456f-bcc2-7fc2b603fce5 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:23.774265 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bf4b3-a3d8-4be4-bc58-f87efa4347bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:23.774969 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bf4b3-a3d8-4be4-bc58-f87efa4347bd None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:23.775337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bf4b3-a3d8-4be4-bc58-f87efa4347bd None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:23.775621 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bf4b3-a3d8-4be4-bc58-f87efa4347bd None admin] PATH_INFO: `/v3/projects/9be5188191974ffc810922498327a37b` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:23.776768 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bf4b3-a3d8-4be4-bc58-f87efa4347bd None admin] RBAC: Authorizing `identity:get_project(project_id=9be5188191974ffc810922498327a37b)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:23.778241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bf4b3-a3d8-4be4-bc58-f87efa4347bd None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:23.779909 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 49/96] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:23 2022] GET /identity/v3/projects/9be5188191974ffc810922498327a37b => generated 312 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:23.786301 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23ec16-84d1-4c15-b06d-8c3e4abe84c1 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:23.857486 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:23.912689 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23ec16-84d1-4c15-b06d-8c3e4abe84c1 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:23.963136 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46663d01-6821-4052-b316-1537301b9865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:23.963748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46663d01-6821-4052-b316-1537301b9865 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:23.964031 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46663d01-6821-4052-b316-1537301b9865 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:23.964305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46663d01-6821-4052-b316-1537301b9865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:23.965042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46663d01-6821-4052-b316-1537301b9865 None admin] RBAC: Adding query filter params (role.id=3fe3a1eb546b456aa3c8bce846a8d37f, scope.project.id=9be5188191974ffc810922498327a37b, user.id=7ff34784d9634d5bb6512d1ca036719d) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:23.965354 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46663d01-6821-4052-b316-1537301b9865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:23.966931 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46663d01-6821-4052-b316-1537301b9865 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:23.973281 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 48/97] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:13:23 2022] GET /identity/v3/role_assignments?user.id=7ff34784d9634d5bb6512d1ca036719d&scope.project.id=9be5188191974ffc810922498327a37b&role.id=3fe3a1eb546b456aa3c8bce846a8d37f => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:25.410285 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e52bd-5aae-4885-8c6e-309e00a71ead None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:25.410828 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e52bd-5aae-4885-8c6e-309e00a71ead None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:25.410828 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e52bd-5aae-4885-8c6e-309e00a71ead None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:25.412483 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 50/98] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:25.417874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b264350-918f-43e9-8de4-88990c160812 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:25.418282 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b264350-918f-43e9-8de4-88990c160812 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:25.418468 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b264350-918f-43e9-8de4-88990c160812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:25.442570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-9b264350-918f-43e9-8de4-88990c160812 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:25.443833 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-9b264350-918f-43e9-8de4-88990c160812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:25.545382 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 49/99] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:25.868344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bafdf-51b8-4ff2-bf85-16d4bd4b5636 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:25.869035 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bafdf-51b8-4ff2-bf85-16d4bd4b5636 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:25.869518 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bafdf-51b8-4ff2-bf85-16d4bd4b5636 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:25.871080 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 51/100] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:25.877410 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6e706-83f1-4101-8bfe-37965b892185 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:25.877919 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6e706-83f1-4101-8bfe-37965b892185 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:25.878412 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6e706-83f1-4101-8bfe-37965b892185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:25.896653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-60d6e706-83f1-4101-8bfe-37965b892185 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:25.898310 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-60d6e706-83f1-4101-8bfe-37965b892185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:25.950130 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:25.974976 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 50/101] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:26.184725 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bafdf-51b8-4ff2-bf85-16d4bd4b5636 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:26.308703 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bafdf-51b8-4ff2-bf85-16d4bd4b5636 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:26.310694 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:26.346964 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f7c61-96dd-4ec3-91d3-0a4925bff229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:26.347649 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f7c61-96dd-4ec3-91d3-0a4925bff229 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:26.347935 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f7c61-96dd-4ec3-91d3-0a4925bff229 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:26.348212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f7c61-96dd-4ec3-91d3-0a4925bff229 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:26.359430 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f7c61-96dd-4ec3-91d3-0a4925bff229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:26.364792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-900f7c61-96dd-4ec3-91d3-0a4925bff229 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:26.364792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:26.364792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:26.364792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:26.364792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:26.364792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:26.364792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:26.364792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:26.364792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:26.364792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:26.364792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:26.364792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:26.364792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:26.364792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:26.364792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:26.364792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:26.365640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:26.365640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:26.365640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:26.365640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:26.365640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:26.365640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:26.365640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:26.365640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:26.365640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:26.365640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:26.365640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:26.365640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:26.365640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:26.365640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:26.365640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:26.365640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:26.366460 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:26.366460 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:26.366460 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:26.366460 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:26.366460 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:26.366460 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:26.366460 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:26.366460 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:26.366460 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:26.366460 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:26.366460 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:26.366460 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:26.366460 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 52/102] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:26.376514 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6e706-83f1-4101-8bfe-37965b892185 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:26.506204 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6e706-83f1-4101-8bfe-37965b892185 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:26.559802 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6964b-edce-4fcb-a8ef-715c5802d902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:26.560464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6964b-edce-4fcb-a8ef-715c5802d902 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:26.560743 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6964b-edce-4fcb-a8ef-715c5802d902 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:26.561010 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6964b-edce-4fcb-a8ef-715c5802d902 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:26.561699 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6964b-edce-4fcb-a8ef-715c5802d902 None admin] RBAC: Adding query filter params (name=member) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:26.561992 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6964b-edce-4fcb-a8ef-715c5802d902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:26.563432 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6964b-edce-4fcb-a8ef-715c5802d902 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:26.574510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 51/103] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:26.580377 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f7c61-96dd-4ec3-91d3-0a4925bff229 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:26.601105 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80685a-9dd2-4039-a19c-d4f37fed09ed None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:26.601383 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80685a-9dd2-4039-a19c-d4f37fed09ed None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:26.601661 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80685a-9dd2-4039-a19c-d4f37fed09ed None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:26.603140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 52/104] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:26.621986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80685a-9dd2-4039-a19c-d4f37fed09ed None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:26.684319 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:26.773702 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f7c61-96dd-4ec3-91d3-0a4925bff229 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:26.794396 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80685a-9dd2-4039-a19c-d4f37fed09ed None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:26.828388 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c315c-046e-4eb3-96fb-57b946ae55f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:26.829033 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c315c-046e-4eb3-96fb-57b946ae55f1 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:26.829373 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c315c-046e-4eb3-96fb-57b946ae55f1 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:26.830142 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c315c-046e-4eb3-96fb-57b946ae55f1 None admin] PATH_INFO: `/v3/users/7ff34784d9634d5bb6512d1ca036719d` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:26.831340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c315c-046e-4eb3-96fb-57b946ae55f1 None admin] RBAC: Authorizing `identity:get_user(user_id=7ff34784d9634d5bb6512d1ca036719d)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:26.832817 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c315c-046e-4eb3-96fb-57b946ae55f1 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:26.834419 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 53/105] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:26 2022] GET /identity/v3/users/7ff34784d9634d5bb6512d1ca036719d => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:26.839553 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab4e12-eaf3-4314-a27d-6ab0f188cfad None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:26.839841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab4e12-eaf3-4314-a27d-6ab0f188cfad None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:26.840123 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab4e12-eaf3-4314-a27d-6ab0f188cfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:26.861632 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bf6af-3c5e-4ccd-9283-039267a74d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:26.862675 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bf6af-3c5e-4ccd-9283-039267a74d40 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:26.863207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bf6af-3c5e-4ccd-9283-039267a74d40 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:26.863725 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bf6af-3c5e-4ccd-9283-039267a74d40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:26.865654 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bf6af-3c5e-4ccd-9283-039267a74d40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:26.867617 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bf6af-3c5e-4ccd-9283-039267a74d40 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:26.869504 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 53/106] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:13:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:26.870522 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bf6af-3c5e-4ccd-9283-039267a74d40 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:26.879285 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-25ab4e12-eaf3-4314-a27d-6ab0f188cfad None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:26.880497 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-25ab4e12-eaf3-4314-a27d-6ab0f188cfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:26.931548 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:26.978606 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 54/107] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:26.979490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab4e12-eaf3-4314-a27d-6ab0f188cfad None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:27.002203 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bf6af-3c5e-4ccd-9283-039267a74d40 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:27.037773 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:27.042226 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdaa43-70c0-4e95-98ba-608279d39a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:27.043301 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdaa43-70c0-4e95-98ba-608279d39a31 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:27.043778 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdaa43-70c0-4e95-98ba-608279d39a31 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:27.044245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdaa43-70c0-4e95-98ba-608279d39a31 None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:27.045967 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdaa43-70c0-4e95-98ba-608279d39a31 None admin] RBAC: Authorizing `identity:get_project(project_id=10ae72b6264047109854b2e9468e9ba3)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:27.047755 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdaa43-70c0-4e95-98ba-608279d39a31 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:27.050151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 54/108] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:26 2022] GET /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:27.059020 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d62e9d-c4d4-4751-a98a-0b9b6c4c28ea None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:27.059020 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d62e9d-c4d4-4751-a98a-0b9b6c4c28ea None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:27.059020 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d62e9d-c4d4-4751-a98a-0b9b6c4c28ea None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:27.059020 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 55/109] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:27.059020 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af354a41-3d69-480e-9032-84043f6b26d5 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:27.059393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af354a41-3d69-480e-9032-84043f6b26d5 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:27.059629 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af354a41-3d69-480e-9032-84043f6b26d5 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:27.060762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 56/110] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:27.061999 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af354a41-3d69-480e-9032-84043f6b26d5 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:27.092645 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab4e12-eaf3-4314-a27d-6ab0f188cfad None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:27.128982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e826d01-1d19-4ade-ae93-1e775008e1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:27.129639 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e826d01-1d19-4ade-ae93-1e775008e1a5 None admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:27.129929 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e826d01-1d19-4ade-ae93-1e775008e1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:27.130210 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e826d01-1d19-4ade-ae93-1e775008e1a5 None admin] PATH_INFO: `/v3/projects` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:27.130899 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e826d01-1d19-4ade-ae93-1e775008e1a5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:27.132391 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e826d01-1d19-4ade-ae93-1e775008e1a5 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:27.168929 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 55/111] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 00:13:26 2022] POST /identity/v3/projects => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:13:27.171282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac106d-8fda-4822-b94b-4292e17e2192 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:27.171763 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac106d-8fda-4822-b94b-4292e17e2192 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:27.172255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac106d-8fda-4822-b94b-4292e17e2192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:27.210864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-7eac106d-8fda-4822-b94b-4292e17e2192 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:27.214517 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-7eac106d-8fda-4822-b94b-4292e17e2192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:27.224946 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af354a41-3d69-480e-9032-84043f6b26d5 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:27.233992 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:27.294951 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425a44d-90c0-4475-9e5c-989bada5845a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:27.295966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425a44d-90c0-4475-9e5c-989bada5845a None admin] REQUEST_METHOD: `PUT` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:27.297503 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425a44d-90c0-4475-9e5c-989bada5845a None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:27.300000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425a44d-90c0-4475-9e5c-989bada5845a None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3/users/7ff34784d9634d5bb6512d1ca036719d/roles/3fe3a1eb546b456aa3c8bce846a8d37f` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:27.304842 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425a44d-90c0-4475-9e5c-989bada5845a None admin] RBAC: Authorizing `identity:create_grant(project_id=10ae72b6264047109854b2e9468e9ba3, user_id=7ff34784d9634d5bb6512d1ca036719d, role_id=3fe3a1eb546b456aa3c8bce846a8d37f)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:27.307583 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425a44d-90c0-4475-9e5c-989bada5845a None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:27.330614 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 57/112] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 00:13:27 2022] PUT /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3/users/7ff34784d9634d5bb6512d1ca036719d/roles/3fe3a1eb546b456aa3c8bce846a8d37f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:13:27.333157 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48601568-ea21-4cb8-8274-0f5980ecaa1f None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:27.333751 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48601568-ea21-4cb8-8274-0f5980ecaa1f None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:27.334213 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48601568-ea21-4cb8-8274-0f5980ecaa1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:27.368613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 56/113] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:27.370599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-48601568-ea21-4cb8-8274-0f5980ecaa1f None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:27.371777 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac106d-8fda-4822-b94b-4292e17e2192 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:27.373274 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-48601568-ea21-4cb8-8274-0f5980ecaa1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:27.447218 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:27.484364 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 58/114] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:27.486511 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c021b-3be4-4480-a2f3-8eae866f68bb None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:27.486868 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c021b-3be4-4480-a2f3-8eae866f68bb None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:27.491147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c021b-3be4-4480-a2f3-8eae866f68bb None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:27.491147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 59/115] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:27.494588 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92515cb-8ae8-49a6-83d1-7b886e9d19d1 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:27.494940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92515cb-8ae8-49a6-83d1-7b886e9d19d1 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:27.495366 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92515cb-8ae8-49a6-83d1-7b886e9d19d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:27.516987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-d92515cb-8ae8-49a6-83d1-7b886e9d19d1 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:27.518387 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-d92515cb-8ae8-49a6-83d1-7b886e9d19d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:27.547249 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac106d-8fda-4822-b94b-4292e17e2192 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:27.587653 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643566cd-52f6-4dc3-8281-5016f2022b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:27.589114 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643566cd-52f6-4dc3-8281-5016f2022b33 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:27.589680 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643566cd-52f6-4dc3-8281-5016f2022b33 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:27.590131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643566cd-52f6-4dc3-8281-5016f2022b33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:27.601072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 60/116] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:27.606887 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643566cd-52f6-4dc3-8281-5016f2022b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:27.611942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-643566cd-52f6-4dc3-8281-5016f2022b33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:13:27.611942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:27.611942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:27.611942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:27.611942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:27.611942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:27.611942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:27.611942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:27.611942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:27.611942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:27.611942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:27.611942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:27.611942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:27.611942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:27.611942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:27.611942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:27.612769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:27.612769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:27.612769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:27.612769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:27.612769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:27.612769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:27.612769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:27.612769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:27.612769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:27.612769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:27.612769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:27.612769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:27.612769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:27.612769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:27.612769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:27.612769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:27.613533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:27.613533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:27.613533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:27.613533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:27.613533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:27.613533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:27.613533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:27.613533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:27.613533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:27.613533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:27.613533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:13:27.613533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:27.616248 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 57/117] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:27.623069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92515cb-8ae8-49a6-83d1-7b886e9d19d1 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:27.733543 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92515cb-8ae8-49a6-83d1-7b886e9d19d1 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:27.735392 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:27.780265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895bd9b-933f-4cdb-9d99-84ef09d0d94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:27.781168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895bd9b-933f-4cdb-9d99-84ef09d0d94a None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:27.781625 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895bd9b-933f-4cdb-9d99-84ef09d0d94a None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:27.782097 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895bd9b-933f-4cdb-9d99-84ef09d0d94a None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:27.783495 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895bd9b-933f-4cdb-9d99-84ef09d0d94a None admin] RBAC: Adding query filter params (name=reader) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:27.783974 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895bd9b-933f-4cdb-9d99-84ef09d0d94a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:27.785604 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895bd9b-933f-4cdb-9d99-84ef09d0d94a None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:27.797320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 61/118] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:27.804062 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643566cd-52f6-4dc3-8281-5016f2022b33 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:27.807885 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:27.885051 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895bd9b-933f-4cdb-9d99-84ef09d0d94a None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:27.966515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643566cd-52f6-4dc3-8281-5016f2022b33 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:28.039247 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895bd9b-933f-4cdb-9d99-84ef09d0d94a None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:28.041214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b760f-e86a-4bbe-8641-990621606b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:28.042027 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b760f-e86a-4bbe-8641-990621606b69 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:28.042376 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b760f-e86a-4bbe-8641-990621606b69 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:28.042749 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b760f-e86a-4bbe-8641-990621606b69 None admin] PATH_INFO: `/v3/users/b1fd014e97f94c81827a0d803f3e93b3` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:28.058812 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b760f-e86a-4bbe-8641-990621606b69 None admin] RBAC: Authorizing `identity:get_user(user_id=b1fd014e97f94c81827a0d803f3e93b3)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:28.060390 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b760f-e86a-4bbe-8641-990621606b69 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:28.062450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 58/119] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:27 2022] GET /identity/v3/users/b1fd014e97f94c81827a0d803f3e93b3 => generated 289 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:28.063227 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b760f-e86a-4bbe-8641-990621606b69 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:28.076648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d8ce7-d52d-40a3-a041-3c42811c6b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:28.077287 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d8ce7-d52d-40a3-a041-3c42811c6b5e None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:28.077569 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d8ce7-d52d-40a3-a041-3c42811c6b5e None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:28.077849 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d8ce7-d52d-40a3-a041-3c42811c6b5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:28.089217 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d8ce7-d52d-40a3-a041-3c42811c6b5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:28.094464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-0e9d8ce7-d52d-40a3-a041-3c42811c6b5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:13:28.094464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:28.094464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:28.094464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:28.094464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:28.094464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:28.094464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:28.094464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:28.094464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:28.094464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:28.094464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:28.094464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:28.094464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:28.094464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:28.094464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:28.094464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:28.095916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:28.095916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:28.095916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:28.095916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:28.095916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:28.095916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:28.095916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:28.095916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:28.095916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:28.095916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:28.095916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:28.095916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:28.095916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:28.095916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:28.095916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:28.095916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:28.096881 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:28.096881 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:28.096881 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:28.096881 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:28.096881 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:28.096881 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:28.096881 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:28.096881 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:28.096881 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:28.096881 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:28.096881 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:13:28.096881 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:13:28.096881 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 62/120] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 00:13:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:28.097618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d8ce7-d52d-40a3-a041-3c42811c6b5e None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:28.128509 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:28.140884 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:28.197083 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b760f-e86a-4bbe-8641-990621606b69 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:28.225154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d8ce7-d52d-40a3-a041-3c42811c6b5e None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:28.245405 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1834fd3-bc1a-4aa8-9916-37d9e8c3837a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:28.246854 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1834fd3-bc1a-4aa8-9916-37d9e8c3837a None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:28.247340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1834fd3-bc1a-4aa8-9916-37d9e8c3837a None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:28.248051 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1834fd3-bc1a-4aa8-9916-37d9e8c3837a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:28.261220 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fd02f-2206-485a-9a5b-fde363c5d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:28.261860 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fd02f-2206-485a-9a5b-fde363c5d3ab None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:28.262134 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fd02f-2206-485a-9a5b-fde363c5d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:28.262413 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fd02f-2206-485a-9a5b-fde363c5d3ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:28.263196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1834fd3-bc1a-4aa8-9916-37d9e8c3837a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:28.269674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-b1834fd3-bc1a-4aa8-9916-37d9e8c3837a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:13:28.269674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:28.269674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:28.269674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:28.269674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:28.269674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:28.269674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:28.269674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:28.269674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:28.269674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:28.269674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:28.269674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:28.269674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:28.269674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:28.269674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:28.269674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:28.270727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:28.270727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:28.270727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:28.270727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:28.270727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:28.270727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:28.270727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:28.270727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:28.270727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:28.270727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:28.270727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:28.270727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:28.270727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:28.270727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:28.270727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:28.270727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:28.271601 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:28.271601 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:28.271601 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:28.271601 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:28.271601 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:28.271601 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:28.271601 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:28.271601 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:28.271601 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:28.271601 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:28.271601 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:13:28.271601 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:28.277359 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 59/121] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:13:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:28.277359 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1834fd3-bc1a-4aa8-9916-37d9e8c3837a None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:28.282487 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0fd02f-2206-485a-9a5b-fde363c5d3ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:28.287785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-0b0fd02f-2206-485a-9a5b-fde363c5d3ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:28.287785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:28.287785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:28.287785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:28.287785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:28.287785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:28.287785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:28.287785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:28.287785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:28.287785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:28.287785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:28.287785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:28.287785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:28.287785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:28.287785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:28.287785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:28.288616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:28.288616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:28.288616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:28.288616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:28.288616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:28.288616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:28.288616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:28.288616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:28.288616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:28.288616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:28.288616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:28.288616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:28.288616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:28.288616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:28.288616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:28.288616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:28.291607 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:28.291607 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:28.291607 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:28.291607 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:28.291607 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:28.291607 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:28.291607 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:28.291607 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:28.291607 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:28.291607 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:28.291607 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:28.291607 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:13:28.291607 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 63/122] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:28.291607 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fd02f-2206-485a-9a5b-fde363c5d3ab None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:28.392920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:28.420166 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fd02f-2206-485a-9a5b-fde363c5d3ab None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:28.423967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1834fd3-bc1a-4aa8-9916-37d9e8c3837a None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:28.446946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:28.464386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e2b19-e197-4ae2-9aed-da497af8b8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:28.465094 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e2b19-e197-4ae2-9aed-da497af8b8d7 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:28.465453 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e2b19-e197-4ae2-9aed-da497af8b8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:28.465827 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e2b19-e197-4ae2-9aed-da497af8b8d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:28.467471 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc54cac-f024-451c-b202-572de4bf5cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:28.468264 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc54cac-f024-451c-b202-572de4bf5cc9 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:28.468889 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc54cac-f024-451c-b202-572de4bf5cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:28.469337 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc54cac-f024-451c-b202-572de4bf5cc9 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:28.471118 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc54cac-f024-451c-b202-572de4bf5cc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:28.471608 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc54cac-f024-451c-b202-572de4bf5cc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:28.473168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc54cac-f024-451c-b202-572de4bf5cc9 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:28.484131 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 64/123] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:28.485328 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc54cac-f024-451c-b202-572de4bf5cc9 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:28.568104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e2b19-e197-4ae2-9aed-da497af8b8d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:28.569985 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e2b19-e197-4ae2-9aed-da497af8b8d7 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:28.605236 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc54cac-f024-451c-b202-572de4bf5cc9 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:28.640850 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0374339-5ef7-40e2-8300-bc76c1769bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:28.641461 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0374339-5ef7-40e2-8300-bc76c1769bdc None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:28.641794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0374339-5ef7-40e2-8300-bc76c1769bdc None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:28.642069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0374339-5ef7-40e2-8300-bc76c1769bdc None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:28.642734 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0374339-5ef7-40e2-8300-bc76c1769bdc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:28.643126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0374339-5ef7-40e2-8300-bc76c1769bdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:28.644559 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0374339-5ef7-40e2-8300-bc76c1769bdc None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:28.657506 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 65/124] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:13:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:28.657506 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0374339-5ef7-40e2-8300-bc76c1769bdc None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:28.671389 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:28.687969 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 60/125] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:13:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:13:28.695072 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e2b19-e197-4ae2-9aed-da497af8b8d7 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:28.720044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:28.776401 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0374339-5ef7-40e2-8300-bc76c1769bdc None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:28.812318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac089a-8f53-4663-9457-7440a47d8d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:28.813315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac089a-8f53-4663-9457-7440a47d8d6f None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:28.814759 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac089a-8f53-4663-9457-7440a47d8d6f None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:28.815339 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac089a-8f53-4663-9457-7440a47d8d6f None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:28.816512 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac089a-8f53-4663-9457-7440a47d8d6f None admin] RBAC: Adding query filter params (name=member) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:28.817024 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac089a-8f53-4663-9457-7440a47d8d6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:28.818664 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e2b19-e197-4ae2-9aed-da497af8b8d7 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:28.818943 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac089a-8f53-4663-9457-7440a47d8d6f None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:28.828671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 66/126] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:28.829936 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac089a-8f53-4663-9457-7440a47d8d6f None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:28.863488 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406262b-7b94-41f6-a135-b750c2250fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:28.864121 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406262b-7b94-41f6-a135-b750c2250fa8 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:28.864405 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406262b-7b94-41f6-a135-b750c2250fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:28.864681 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406262b-7b94-41f6-a135-b750c2250fa8 None admin] PATH_INFO: `/v3/users/ba9622273acc4179a07cafb4c9699780` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:28.865831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406262b-7b94-41f6-a135-b750c2250fa8 None admin] RBAC: Authorizing `identity:get_user(user_id=ba9622273acc4179a07cafb4c9699780)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:28.868047 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406262b-7b94-41f6-a135-b750c2250fa8 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:28.869136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 61/127] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:28 2022] GET /identity/v3/users/ba9622273acc4179a07cafb4c9699780 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:28.869911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406262b-7b94-41f6-a135-b750c2250fa8 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:28.904282 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:28.936856 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac089a-8f53-4663-9457-7440a47d8d6f None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:28.972641 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f984f02-2dc6-45cc-b803-1c42d55bb11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:28.973259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:28.974456 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f984f02-2dc6-45cc-b803-1c42d55bb11d None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:28.974987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f984f02-2dc6-45cc-b803-1c42d55bb11d None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:28.975470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f984f02-2dc6-45cc-b803-1c42d55bb11d None admin] PATH_INFO: `/v3/users/7ff34784d9634d5bb6512d1ca036719d` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:28.977773 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f984f02-2dc6-45cc-b803-1c42d55bb11d None admin] RBAC: Authorizing `identity:get_user(user_id=7ff34784d9634d5bb6512d1ca036719d)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:28.979593 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f984f02-2dc6-45cc-b803-1c42d55bb11d None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:28.981767 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 67/128] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:28 2022] GET /identity/v3/users/7ff34784d9634d5bb6512d1ca036719d => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:28.983893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f984f02-2dc6-45cc-b803-1c42d55bb11d None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:28.987745 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406262b-7b94-41f6-a135-b750c2250fa8 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:29.029023 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c5a7d-ca5f-4ec4-9a57-209a479730ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:29.029665 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c5a7d-ca5f-4ec4-9a57-209a479730ee None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:29.029950 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c5a7d-ca5f-4ec4-9a57-209a479730ee None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:29.030226 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c5a7d-ca5f-4ec4-9a57-209a479730ee None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:29.031401 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c5a7d-ca5f-4ec4-9a57-209a479730ee None admin] RBAC: Authorizing `identity:get_project(project_id=10ae72b6264047109854b2e9468e9ba3)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:29.033008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c5a7d-ca5f-4ec4-9a57-209a479730ee None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:29.040106 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 62/129] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:28 2022] GET /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:29.040106 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c5a7d-ca5f-4ec4-9a57-209a479730ee None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:29.106800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f984f02-2dc6-45cc-b803-1c42d55bb11d None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:29.144520 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c5a7d-ca5f-4ec4-9a57-209a479730ee None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:29.145258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c2671-fda3-4015-b77a-f9c3ed6b84bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:29.146237 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c2671-fda3-4015-b77a-f9c3ed6b84bf None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:29.146750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c2671-fda3-4015-b77a-f9c3ed6b84bf None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:29.147292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c2671-fda3-4015-b77a-f9c3ed6b84bf None admin] PATH_INFO: `/v3/users/7ff34784d9634d5bb6512d1ca036719d` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:29.148646 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c2671-fda3-4015-b77a-f9c3ed6b84bf None admin] RBAC: Authorizing `identity:get_user(user_id=7ff34784d9634d5bb6512d1ca036719d)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:29.150332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c2671-fda3-4015-b77a-f9c3ed6b84bf None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:29.152183 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 68/130] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:28 2022] GET /identity/v3/users/7ff34784d9634d5bb6512d1ca036719d => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:29.153399 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c2671-fda3-4015-b77a-f9c3ed6b84bf None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:29.164013 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:29.184085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5eef3a-3ee9-4902-ae27-8a28f210c3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:29.185004 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eef3a-3ee9-4902-ae27-8a28f210c3ab None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:29.185560 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eef3a-3ee9-4902-ae27-8a28f210c3ab None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:29.186037 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eef3a-3ee9-4902-ae27-8a28f210c3ab None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:29.187425 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5eef3a-3ee9-4902-ae27-8a28f210c3ab None admin] RBAC: Authorizing `identity:get_project(project_id=10ae72b6264047109854b2e9468e9ba3)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:29.189706 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5eef3a-3ee9-4902-ae27-8a28f210c3ab None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:29.192155 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 63/131] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:29 2022] GET /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:29.193094 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5eef3a-3ee9-4902-ae27-8a28f210c3ab None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:29.220339 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:29.268347 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c2671-fda3-4015-b77a-f9c3ed6b84bf None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:29.302786 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5eef3a-3ee9-4902-ae27-8a28f210c3ab None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:29.306424 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdcf14-3ac7-4e72-bf87-920d0ccd8c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:29.306555 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdcf14-3ac7-4e72-bf87-920d0ccd8c3a None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:29.306855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdcf14-3ac7-4e72-bf87-920d0ccd8c3a None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:29.307232 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdcf14-3ac7-4e72-bf87-920d0ccd8c3a None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:29.308423 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fdcf14-3ac7-4e72-bf87-920d0ccd8c3a None admin] RBAC: Authorizing `identity:get_project(project_id=10ae72b6264047109854b2e9468e9ba3)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:29.310056 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fdcf14-3ac7-4e72-bf87-920d0ccd8c3a None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:29.317529 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 69/132] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:29 2022] GET /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:29.318687 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdcf14-3ac7-4e72-bf87-920d0ccd8c3a None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:29.341859 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262a2af-81c2-4c0b-a0e9-fe3440e105fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:29.342763 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262a2af-81c2-4c0b-a0e9-fe3440e105fa None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:29.343364 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262a2af-81c2-4c0b-a0e9-fe3440e105fa None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:29.343850 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262a2af-81c2-4c0b-a0e9-fe3440e105fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:29.345437 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262a2af-81c2-4c0b-a0e9-fe3440e105fa None admin] RBAC: Adding query filter params (role.id=4eba322b310a4c6a8962dfb897571cf3, scope.project.id=10ae72b6264047109854b2e9468e9ba3, user.id=b1fd014e97f94c81827a0d803f3e93b3) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:29.345950 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262a2af-81c2-4c0b-a0e9-fe3440e105fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:29.347824 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262a2af-81c2-4c0b-a0e9-fe3440e105fa None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:29.354202 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 64/133] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:13:29 2022] GET /identity/v3/role_assignments?user.id=b1fd014e97f94c81827a0d803f3e93b3&scope.project.id=10ae72b6264047109854b2e9468e9ba3&role.id=4eba322b310a4c6a8962dfb897571cf3 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:29.355312 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262a2af-81c2-4c0b-a0e9-fe3440e105fa None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:29.460009 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:29.479379 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:29.493347 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262a2af-81c2-4c0b-a0e9-fe3440e105fa None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:29.508416 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdcf14-3ac7-4e72-bf87-920d0ccd8c3a None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:29.552931 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcbf1a-fb7d-456e-99c3-a48d51f93dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:29.553582 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcbf1a-fb7d-456e-99c3-a48d51f93dfa None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:29.553863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcbf1a-fb7d-456e-99c3-a48d51f93dfa None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:29.554136 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcbf1a-fb7d-456e-99c3-a48d51f93dfa None admin] PATH_INFO: `/v3/projects/9be5188191974ffc810922498327a37b` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:29.555983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcbf1a-fb7d-456e-99c3-a48d51f93dfa None admin] RBAC: Authorizing `identity:get_project(project_id=9be5188191974ffc810922498327a37b)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:29.557476 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcbf1a-fb7d-456e-99c3-a48d51f93dfa None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:29.559270 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 70/134] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:29 2022] GET /identity/v3/projects/9be5188191974ffc810922498327a37b => generated 312 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:29.563677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dde08b-201a-4ff8-b4d6-e52fb515f1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:29.564522 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dde08b-201a-4ff8-b4d6-e52fb515f1a2 None admin] REQUEST_METHOD: `PUT` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:29.564891 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dde08b-201a-4ff8-b4d6-e52fb515f1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:29.565177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dde08b-201a-4ff8-b4d6-e52fb515f1a2 None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3/users/ba9622273acc4179a07cafb4c9699780/roles/9b372d4fe82a4a54a3ecd29e7b912586` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:29.567440 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dde08b-201a-4ff8-b4d6-e52fb515f1a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=10ae72b6264047109854b2e9468e9ba3, user_id=ba9622273acc4179a07cafb4c9699780, role_id=9b372d4fe82a4a54a3ecd29e7b912586)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:29.568866 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcbf1a-fb7d-456e-99c3-a48d51f93dfa None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:29.570138 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dde08b-201a-4ff8-b4d6-e52fb515f1a2 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:29.597469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 65/135] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 00:13:29 2022] PUT /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3/users/ba9622273acc4179a07cafb4c9699780/roles/9b372d4fe82a4a54a3ecd29e7b912586 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:13:29.598623 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dde08b-201a-4ff8-b4d6-e52fb515f1a2 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:29.793094 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dde08b-201a-4ff8-b4d6-e52fb515f1a2 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:29.795360 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcbf1a-fb7d-456e-99c3-a48d51f93dfa None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:29.857361 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15152cad-36e2-42ba-9a74-b61506704213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:29.858380 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15152cad-36e2-42ba-9a74-b61506704213 None admin] REQUEST_METHOD: `PUT` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:29.858906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15152cad-36e2-42ba-9a74-b61506704213 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:29.859401 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15152cad-36e2-42ba-9a74-b61506704213 None admin] PATH_INFO: `/v3/projects/9be5188191974ffc810922498327a37b/users/7ff34784d9634d5bb6512d1ca036719d/roles/3fe3a1eb546b456aa3c8bce846a8d37f` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:29.862409 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15152cad-36e2-42ba-9a74-b61506704213 None admin] RBAC: Authorizing `identity:create_grant(project_id=9be5188191974ffc810922498327a37b, user_id=7ff34784d9634d5bb6512d1ca036719d, role_id=3fe3a1eb546b456aa3c8bce846a8d37f)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:29.864431 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15152cad-36e2-42ba-9a74-b61506704213 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:29.867956 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b605fb5-1f12-4c9e-b605-7906cfe59038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:29.868918 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b605fb5-1f12-4c9e-b605-7906cfe59038 None admin] REQUEST_METHOD: `PUT` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:29.869393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b605fb5-1f12-4c9e-b605-7906cfe59038 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:29.869857 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b605fb5-1f12-4c9e-b605-7906cfe59038 None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3/users/7ff34784d9634d5bb6512d1ca036719d/roles/a7db20dbcb4b458d932c564bc9ad5bfb` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:29.872495 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b605fb5-1f12-4c9e-b605-7906cfe59038 None admin] RBAC: Authorizing `identity:create_grant(project_id=10ae72b6264047109854b2e9468e9ba3, user_id=7ff34784d9634d5bb6512d1ca036719d, role_id=a7db20dbcb4b458d932c564bc9ad5bfb)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:29.875112 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b605fb5-1f12-4c9e-b605-7906cfe59038 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:29.898037 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 66/136] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 00:13:29 2022] PUT /identity/v3/projects/9be5188191974ffc810922498327a37b/users/7ff34784d9634d5bb6512d1ca036719d/roles/3fe3a1eb546b456aa3c8bce846a8d37f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:13:29.898660 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 71/137] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 00:13:29 2022] PUT /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3/users/7ff34784d9634d5bb6512d1ca036719d/roles/a7db20dbcb4b458d932c564bc9ad5bfb => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:13:29.956437 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda6fea-649e-47f5-baaf-4f2e34f377bc None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:29.956743 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda6fea-649e-47f5-baaf-4f2e34f377bc None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:29.956993 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda6fea-649e-47f5-baaf-4f2e34f377bc None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:29.958595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 72/138] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:29.964878 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2907d9f-7771-4083-9a1e-8fbe43a38809 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:29.965179 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2907d9f-7771-4083-9a1e-8fbe43a38809 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:29.965443 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2907d9f-7771-4083-9a1e-8fbe43a38809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:29.985765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-f2907d9f-7771-4083-9a1e-8fbe43a38809 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:29.987034 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-f2907d9f-7771-4083-9a1e-8fbe43a38809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:29.989622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:30.080521 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 67/139] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:13:30.248768 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75922a-0c68-4c3a-8a9b-e30667ede376 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:30.249081 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75922a-0c68-4c3a-8a9b-e30667ede376 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:30.249439 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75922a-0c68-4c3a-8a9b-e30667ede376 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:30.250781 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 73/140] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:30.257248 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d45ee-abe9-4891-bf20-72e3e8f69df6 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:30.257584 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d45ee-abe9-4891-bf20-72e3e8f69df6 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:30.257861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d45ee-abe9-4891-bf20-72e3e8f69df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:30.282901 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-0f0d45ee-abe9-4891-bf20-72e3e8f69df6 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:30.284112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-0f0d45ee-abe9-4891-bf20-72e3e8f69df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:30.358935 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 68/141] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:30.550535 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75922a-0c68-4c3a-8a9b-e30667ede376 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:30.553764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:30.671410 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75922a-0c68-4c3a-8a9b-e30667ede376 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:30.712347 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c867c-ad2d-459f-8c23-8f7e7837c21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:30.713037 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c867c-ad2d-459f-8c23-8f7e7837c21e None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:30.713394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c867c-ad2d-459f-8c23-8f7e7837c21e None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:30.713661 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c867c-ad2d-459f-8c23-8f7e7837c21e None admin] PATH_INFO: `/v3/roles/member` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:30.725535 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c867c-ad2d-459f-8c23-8f7e7837c21e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:30.730891 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-5a3c867c-ad2d-459f-8c23-8f7e7837c21e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:30.730891 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:30.730891 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:30.730891 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:30.730891 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:30.730891 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:30.730891 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:30.730891 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:30.730891 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:30.730891 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:30.730891 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:30.730891 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:30.730891 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:30.730891 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:30.730891 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:30.730891 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:30.731748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:30.731748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:30.731748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:30.731748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:30.731748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:30.731748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:30.731748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:30.731748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:30.731748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:30.731748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:30.731748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:30.731748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:30.731748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:30.731748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:30.731748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:30.731748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:30.732496 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:30.732496 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:30.732496 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:30.732496 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:30.732496 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:30.732496 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:30.732496 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:30.732496 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:30.732496 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:30.732496 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:30.732496 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:30.732496 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:13:30.734967 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 74/142] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:30.743695 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d45ee-abe9-4891-bf20-72e3e8f69df6 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:30.842681 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:30.880072 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d45ee-abe9-4891-bf20-72e3e8f69df6 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:30.915351 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2be84d-82a7-4796-8907-d44d55a1429e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:30.916327 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2be84d-82a7-4796-8907-d44d55a1429e None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:30.916810 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2be84d-82a7-4796-8907-d44d55a1429e None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:30.917304 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2be84d-82a7-4796-8907-d44d55a1429e None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:30.918189 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2be84d-82a7-4796-8907-d44d55a1429e None admin] RBAC: Adding query filter params (name=member) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:30.918711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2be84d-82a7-4796-8907-d44d55a1429e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:30.920404 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2be84d-82a7-4796-8907-d44d55a1429e None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:30.929954 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c867c-ad2d-459f-8c23-8f7e7837c21e None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:30.932733 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 69/143] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:30.938376 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2be84d-82a7-4796-8907-d44d55a1429e None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:31.061175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2be84d-82a7-4796-8907-d44d55a1429e None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:31.088589 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:31.095793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:31.101568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176ca6f-3509-4e5c-a42e-108a3eb6d545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:31.102471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176ca6f-3509-4e5c-a42e-108a3eb6d545 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:31.102952 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176ca6f-3509-4e5c-a42e-108a3eb6d545 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:31.103454 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176ca6f-3509-4e5c-a42e-108a3eb6d545 None admin] PATH_INFO: `/v3/users/7ff34784d9634d5bb6512d1ca036719d` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:31.104798 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176ca6f-3509-4e5c-a42e-108a3eb6d545 None admin] RBAC: Authorizing `identity:get_user(user_id=7ff34784d9634d5bb6512d1ca036719d)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:31.106820 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176ca6f-3509-4e5c-a42e-108a3eb6d545 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:31.108811 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 70/144] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:30 2022] GET /identity/v3/users/7ff34784d9634d5bb6512d1ca036719d => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:31.116537 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176ca6f-3509-4e5c-a42e-108a3eb6d545 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:31.189830 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c867c-ad2d-459f-8c23-8f7e7837c21e None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:31.275902 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bffeaf-42e8-4c9c-ba98-5d51eeaeb023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:31.276635 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bffeaf-42e8-4c9c-ba98-5d51eeaeb023 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:31.276917 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bffeaf-42e8-4c9c-ba98-5d51eeaeb023 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:31.277189 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bffeaf-42e8-4c9c-ba98-5d51eeaeb023 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:31.280011 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176ca6f-3509-4e5c-a42e-108a3eb6d545 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:31.287007 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bffeaf-42e8-4c9c-ba98-5d51eeaeb023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:31.287007 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bffeaf-42e8-4c9c-ba98-5d51eeaeb023 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:31.287007 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 75/145] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:13:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:31.295903 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bffeaf-42e8-4c9c-ba98-5d51eeaeb023 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:31.356569 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46aec85-efa5-475f-a16e-863f6b6c48a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:31.357187 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aec85-efa5-475f-a16e-863f6b6c48a9 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:31.357477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aec85-efa5-475f-a16e-863f6b6c48a9 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:31.357758 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aec85-efa5-475f-a16e-863f6b6c48a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:31.493861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:31.500100 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46aec85-efa5-475f-a16e-863f6b6c48a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:31.501944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46aec85-efa5-475f-a16e-863f6b6c48a9 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:31.564328 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bffeaf-42e8-4c9c-ba98-5d51eeaeb023 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:31.694209 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:31.714058 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adfb31-1069-4fe0-92ba-c8953da6c9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:31.714680 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adfb31-1069-4fe0-92ba-c8953da6c9b6 None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:31.714959 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adfb31-1069-4fe0-92ba-c8953da6c9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:31.715258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adfb31-1069-4fe0-92ba-c8953da6c9b6 None admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:31.715913 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adfb31-1069-4fe0-92ba-c8953da6c9b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:31.717358 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adfb31-1069-4fe0-92ba-c8953da6c9b6 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:31.786237 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 76/146] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 00:13:31 2022] POST /identity/v3/users => generated 283 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:13:31.869183 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 71/147] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:13:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 753 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:13:31.883440 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adfb31-1069-4fe0-92ba-c8953da6c9b6 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:32.113258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adfb31-1069-4fe0-92ba-c8953da6c9b6 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:32.183181 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3a928-6102-4f48-8fdc-5eb5f56cdf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:32.183921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3a928-6102-4f48-8fdc-5eb5f56cdf28 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:32.184206 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3a928-6102-4f48-8fdc-5eb5f56cdf28 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:32.184481 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3a928-6102-4f48-8fdc-5eb5f56cdf28 None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:32.185611 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3a928-6102-4f48-8fdc-5eb5f56cdf28 None admin] RBAC: Authorizing `identity:get_project(project_id=10ae72b6264047109854b2e9468e9ba3)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:32.187098 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3a928-6102-4f48-8fdc-5eb5f56cdf28 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:32.189263 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 77/148] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:31 2022] GET /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:32.199830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46aec85-efa5-475f-a16e-863f6b6c48a9 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:32.356992 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:32.361752 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46aec85-efa5-475f-a16e-863f6b6c48a9 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:32.411882 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4410697-7dfb-4ac8-bf36-5d83c8e09da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:32.412399 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4410697-7dfb-4ac8-bf36-5d83c8e09da2 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:32.412685 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4410697-7dfb-4ac8-bf36-5d83c8e09da2 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:32.412999 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4410697-7dfb-4ac8-bf36-5d83c8e09da2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:32.413775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4410697-7dfb-4ac8-bf36-5d83c8e09da2 None admin] RBAC: Adding query filter params (role.id=3fe3a1eb546b456aa3c8bce846a8d37f, scope.project.id=10ae72b6264047109854b2e9468e9ba3, user.id=7ff34784d9634d5bb6512d1ca036719d) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:32.414104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4410697-7dfb-4ac8-bf36-5d83c8e09da2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:32.415651 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4410697-7dfb-4ac8-bf36-5d83c8e09da2 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:32.422450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 72/149] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:13:32 2022] GET /identity/v3/role_assignments?user.id=7ff34784d9634d5bb6512d1ca036719d&scope.project.id=10ae72b6264047109854b2e9468e9ba3&role.id=3fe3a1eb546b456aa3c8bce846a8d37f => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:32.566506 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c918f18-914c-4563-87dd-b4722458fef4 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:32.566808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c918f18-914c-4563-87dd-b4722458fef4 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:32.567104 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c918f18-914c-4563-87dd-b4722458fef4 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:32.568466 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 78/150] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:32.577647 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea9ebc-d435-460d-ad64-2e971400ad15 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:32.577968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea9ebc-d435-460d-ad64-2e971400ad15 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:32.578199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea9ebc-d435-460d-ad64-2e971400ad15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:32.597586 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-abea9ebc-d435-460d-ad64-2e971400ad15 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:32.598797 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-abea9ebc-d435-460d-ad64-2e971400ad15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:32.685408 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 73/151] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:32.951275 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302c14c-e3a1-4d72-ba19-1dceaa269a61 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:32.951625 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302c14c-e3a1-4d72-ba19-1dceaa269a61 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:32.951808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302c14c-e3a1-4d72-ba19-1dceaa269a61 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:32.953121 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 79/152] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:32.959171 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c4b91-306f-47a0-a9c9-d842d57b3435 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:32.959642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c4b91-306f-47a0-a9c9-d842d57b3435 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:32.959733 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c4b91-306f-47a0-a9c9-d842d57b3435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:32.979359 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-3b5c4b91-306f-47a0-a9c9-d842d57b3435 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:32.980551 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-3b5c4b91-306f-47a0-a9c9-d842d57b3435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:33.062069 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 74/153] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:33.182714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302c14c-e3a1-4d72-ba19-1dceaa269a61 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:33.256509 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:33.281424 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab5fbb-e30f-4bff-abc6-9d1865618b90 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:33.281738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab5fbb-e30f-4bff-abc6-9d1865618b90 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:33.282008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab5fbb-e30f-4bff-abc6-9d1865618b90 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:33.284007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 75/154] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:33.289783 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efdef6-cb2e-4309-9d83-e453cfc33958 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:33.290071 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efdef6-cb2e-4309-9d83-e453cfc33958 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:33.290349 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efdef6-cb2e-4309-9d83-e453cfc33958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:33.314449 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302c14c-e3a1-4d72-ba19-1dceaa269a61 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:33.324535 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-88efdef6-cb2e-4309-9d83-e453cfc33958 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:33.328162 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-88efdef6-cb2e-4309-9d83-e453cfc33958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:33.351682 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499e773-6de9-4b88-80c3-462223d21a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:33.352482 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499e773-6de9-4b88-80c3-462223d21a28 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:33.352767 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499e773-6de9-4b88-80c3-462223d21a28 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:33.353041 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499e773-6de9-4b88-80c3-462223d21a28 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:33.359200 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:33.365439 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499e773-6de9-4b88-80c3-462223d21a28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:33.370720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-1499e773-6de9-4b88-80c3-462223d21a28 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:13:33.370720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:33.370720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:33.370720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:33.370720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:33.370720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:33.370720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:33.370720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:33.370720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:33.370720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:33.370720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:33.370720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:33.370720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:33.370720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:33.370720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:33.370720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:33.371653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:33.371653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:33.371653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:33.371653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:33.371653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:33.371653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:33.371653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:33.371653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:33.371653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:33.371653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:33.371653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:33.371653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:33.371653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:33.371653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:33.371653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:33.371653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:33.372442 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:33.372442 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:33.372442 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:33.372442 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:33.372442 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:33.372442 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:33.372442 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:33.372442 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:33.372442 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:33.372442 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:33.372442 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:13:33.372442 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:13:33.372442 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 80/155] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:33.380715 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499e773-6de9-4b88-80c3-462223d21a28 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:33.457917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 76/156] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:33.499965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499e773-6de9-4b88-80c3-462223d21a28 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:33.516677 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:33.537996 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1439908-9cb6-4632-9f4f-34e8e960ee24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:33.538666 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1439908-9cb6-4632-9f4f-34e8e960ee24 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:33.538953 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1439908-9cb6-4632-9f4f-34e8e960ee24 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:33.539263 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1439908-9cb6-4632-9f4f-34e8e960ee24 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:33.539944 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1439908-9cb6-4632-9f4f-34e8e960ee24 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:33.540248 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1439908-9cb6-4632-9f4f-34e8e960ee24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:33.541652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1439908-9cb6-4632-9f4f-34e8e960ee24 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:33.551196 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 81/157] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:33.556968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efdef6-cb2e-4309-9d83-e453cfc33958 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:33.634674 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1439908-9cb6-4632-9f4f-34e8e960ee24 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:33.724093 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efdef6-cb2e-4309-9d83-e453cfc33958 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:33.767531 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbb680-d748-4d12-8329-f6e907d39e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:33.768985 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbb680-d748-4d12-8329-f6e907d39e16 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:33.769569 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbb680-d748-4d12-8329-f6e907d39e16 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:33.770136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbb680-d748-4d12-8329-f6e907d39e16 None admin] PATH_INFO: `/v3/users/b1fd014e97f94c81827a0d803f3e93b3` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:33.772003 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdbb680-d748-4d12-8329-f6e907d39e16 None admin] RBAC: Authorizing `identity:get_user(user_id=b1fd014e97f94c81827a0d803f3e93b3)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:33.774103 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdbb680-d748-4d12-8329-f6e907d39e16 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:33.776274 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 77/158] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:33 2022] GET /identity/v3/users/b1fd014e97f94c81827a0d803f3e93b3 => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:33.783160 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbb680-d748-4d12-8329-f6e907d39e16 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:33.839435 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:33.885804 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1439908-9cb6-4632-9f4f-34e8e960ee24 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:33.917516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbb680-d748-4d12-8329-f6e907d39e16 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:33.957887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499459d-db0b-4d15-90fe-a4dfbd1582cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:33.958680 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499459d-db0b-4d15-90fe-a4dfbd1582cb None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:33.959091 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499459d-db0b-4d15-90fe-a4dfbd1582cb None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:33.959488 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499459d-db0b-4d15-90fe-a4dfbd1582cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:33.971602 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499459d-db0b-4d15-90fe-a4dfbd1582cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:33.977269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-2499459d-db0b-4d15-90fe-a4dfbd1582cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:13:33.977269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:33.977269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:33.977269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:33.977269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:33.977269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:33.977269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:33.977269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:33.977269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:33.977269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:33.977269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:33.977269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:33.977269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:33.977269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:33.977269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:33.977269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:33.978431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:33.978431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:33.978431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:33.978431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:33.978431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:33.978431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:33.978431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:33.978431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:33.978431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:33.978431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:33.978431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:33.978431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:33.978431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:33.978431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:33.978431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:33.978431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:33.979413 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:33.979413 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:33.979413 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:33.979413 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:33.979413 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:33.979413 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:33.979413 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:33.979413 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:33.979413 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:33.979413 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:33.979413 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:13:33.979413 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:13:33.981251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 82/159] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 00:13:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:13:33.982125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499459d-db0b-4d15-90fe-a4dfbd1582cb None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:33.987076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c89586-ba11-4e6d-84a9-34c03449125d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:33.988361 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c89586-ba11-4e6d-84a9-34c03449125d None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:33.988801 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c89586-ba11-4e6d-84a9-34c03449125d None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:33.989248 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c89586-ba11-4e6d-84a9-34c03449125d None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:33.990576 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c89586-ba11-4e6d-84a9-34c03449125d None admin] RBAC: Authorizing `identity:get_project(project_id=10ae72b6264047109854b2e9468e9ba3)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:33.992352 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c89586-ba11-4e6d-84a9-34c03449125d None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:33.997578 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 78/160] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:33 2022] GET /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:33.999450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89205578-b49b-4b6f-a183-47e29487ff65 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:33.999880 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89205578-b49b-4b6f-a183-47e29487ff65 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:34.000404 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89205578-b49b-4b6f-a183-47e29487ff65 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:34.001913 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 79/161] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:34.002962 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89205578-b49b-4b6f-a183-47e29487ff65 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:34.023018 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:34.119374 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:34.126588 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499459d-db0b-4d15-90fe-a4dfbd1582cb None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:34.164508 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c864a1d-093f-45d4-bf19-85baff73782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:34.165242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c864a1d-093f-45d4-bf19-85baff73782c None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:34.165566 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89205578-b49b-4b6f-a183-47e29487ff65 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:34.165688 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c864a1d-093f-45d4-bf19-85baff73782c None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:34.165988 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c864a1d-093f-45d4-bf19-85baff73782c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:34.183021 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c864a1d-093f-45d4-bf19-85baff73782c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:34.184473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-6c864a1d-093f-45d4-bf19-85baff73782c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:13:34.184473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:34.184473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:34.184473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:34.184473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:34.184473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:34.184473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:34.184473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:34.184473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:34.184473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:34.184473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:34.184473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:34.184473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:34.184473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:34.184473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:34.184473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:34.185388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:34.185388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:34.185388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:34.185388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:34.185388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:34.185388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:34.185388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:34.185388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:34.185388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:34.185388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:34.185388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:34.185388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:34.185388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:34.185388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:34.185388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:34.185388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:34.186193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:34.186193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:34.186193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:34.186193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:34.186193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:34.186193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:34.186193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:34.186193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:34.186193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:34.186193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:34.186193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:13:34.186193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:13:34.186193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 83/162] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:13:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:34.186829 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf03a9b-6ae6-4b77-ad72-b42eb026a667 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:34.187391 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf03a9b-6ae6-4b77-ad72-b42eb026a667 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:34.187391 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf03a9b-6ae6-4b77-ad72-b42eb026a667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:34.206727 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-cdf03a9b-6ae6-4b77-ad72-b42eb026a667 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:34.207966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-cdf03a9b-6ae6-4b77-ad72-b42eb026a667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:34.233918 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67921e-a695-47d9-ac36-a905db674030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:34.234641 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67921e-a695-47d9-ac36-a905db674030 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:34.234933 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67921e-a695-47d9-ac36-a905db674030 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:34.235268 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67921e-a695-47d9-ac36-a905db674030 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:34.235941 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67921e-a695-47d9-ac36-a905db674030 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:34.236354 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67921e-a695-47d9-ac36-a905db674030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:34.237843 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67921e-a695-47d9-ac36-a905db674030 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:34.259050 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 80/163] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:34.260229 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67921e-a695-47d9-ac36-a905db674030 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:34.291838 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 84/164] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:34.292526 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf03a9b-6ae6-4b77-ad72-b42eb026a667 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:34.327385 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:34.425143 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf03a9b-6ae6-4b77-ad72-b42eb026a667 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:34.497600 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ab62a-5cd7-4e42-a47c-1eaa914fd0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:34.498586 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ab62a-5cd7-4e42-a47c-1eaa914fd0a9 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:34.499073 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ab62a-5cd7-4e42-a47c-1eaa914fd0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:34.499607 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ab62a-5cd7-4e42-a47c-1eaa914fd0a9 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:34.500529 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ab62a-5cd7-4e42-a47c-1eaa914fd0a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:34.501657 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ab62a-5cd7-4e42-a47c-1eaa914fd0a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:34.503269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ab62a-5cd7-4e42-a47c-1eaa914fd0a9 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:34.518250 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 85/165] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:13:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:34.521012 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ab62a-5cd7-4e42-a47c-1eaa914fd0a9 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:34.524968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67921e-a695-47d9-ac36-a905db674030 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:34.599690 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8053831-b1a0-4390-96e4-3964f8c48caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:34.600272 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8053831-b1a0-4390-96e4-3964f8c48caa None admin] REQUEST_METHOD: `PUT` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:34.600603 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8053831-b1a0-4390-96e4-3964f8c48caa None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:34.600880 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8053831-b1a0-4390-96e4-3964f8c48caa None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3/users/b1fd014e97f94c81827a0d803f3e93b3/roles/4eba322b310a4c6a8962dfb897571cf3` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:34.606195 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8053831-b1a0-4390-96e4-3964f8c48caa None admin] RBAC: Authorizing `identity:create_grant(project_id=10ae72b6264047109854b2e9468e9ba3, user_id=b1fd014e97f94c81827a0d803f3e93b3, role_id=4eba322b310a4c6a8962dfb897571cf3)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:34.607753 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8053831-b1a0-4390-96e4-3964f8c48caa None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:34.629423 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 81/166] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 00:13:34 2022] PUT /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3/users/b1fd014e97f94c81827a0d803f3e93b3/roles/4eba322b310a4c6a8962dfb897571cf3 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:13:34.630670 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8053831-b1a0-4390-96e4-3964f8c48caa None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:34.657581 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:34.703503 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:34.727858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ab62a-5cd7-4e42-a47c-1eaa914fd0a9 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:34.783719 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcc7c9-1115-4041-ac7b-659a65ea9491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:34.784768 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcc7c9-1115-4041-ac7b-659a65ea9491 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:34.785286 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcc7c9-1115-4041-ac7b-659a65ea9491 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:34.785760 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcc7c9-1115-4041-ac7b-659a65ea9491 None admin] PATH_INFO: `/v3/users/ba9622273acc4179a07cafb4c9699780` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:34.788088 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bcc7c9-1115-4041-ac7b-659a65ea9491 None admin] RBAC: Authorizing `identity:get_user(user_id=ba9622273acc4179a07cafb4c9699780)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:34.789801 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bcc7c9-1115-4041-ac7b-659a65ea9491 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:34.792149 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 86/167] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:34 2022] GET /identity/v3/users/ba9622273acc4179a07cafb4c9699780 => generated 247 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:34.798099 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcc7c9-1115-4041-ac7b-659a65ea9491 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:34.868375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8053831-b1a0-4390-96e4-3964f8c48caa None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:34.924918 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca4d67-4969-4eb9-90d9-5bcf222f0810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:34.925578 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca4d67-4969-4eb9-90d9-5bcf222f0810 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:34.925851 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca4d67-4969-4eb9-90d9-5bcf222f0810 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:34.926126 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca4d67-4969-4eb9-90d9-5bcf222f0810 None admin] PATH_INFO: `/v3/users/7ff34784d9634d5bb6512d1ca036719d` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:34.931885 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca4d67-4969-4eb9-90d9-5bcf222f0810 None admin] RBAC: Authorizing `identity:get_user(user_id=7ff34784d9634d5bb6512d1ca036719d)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:34.933390 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca4d67-4969-4eb9-90d9-5bcf222f0810 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:34.933968 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcc7c9-1115-4041-ac7b-659a65ea9491 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:34.935133 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 82/168] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:34 2022] GET /identity/v3/users/7ff34784d9634d5bb6512d1ca036719d => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:34.935940 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca4d67-4969-4eb9-90d9-5bcf222f0810 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:34.984093 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0ff9e-4a72-4d58-b854-5be47045dc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:34.986455 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0ff9e-4a72-4d58-b854-5be47045dc11 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:34.987017 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0ff9e-4a72-4d58-b854-5be47045dc11 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:34.987514 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0ff9e-4a72-4d58-b854-5be47045dc11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:35.030533 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:35.054320 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:35.097904 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca4d67-4969-4eb9-90d9-5bcf222f0810 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:35.120305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0ff9e-4a72-4d58-b854-5be47045dc11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:35.121760 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0ff9e-4a72-4d58-b854-5be47045dc11 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:35.167322 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dded2-82d9-4140-a0f1-7b6fca24dd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:35.168020 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dded2-82d9-4140-a0f1-7b6fca24dd41 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:35.168298 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dded2-82d9-4140-a0f1-7b6fca24dd41 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:35.168566 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dded2-82d9-4140-a0f1-7b6fca24dd41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:35.193719 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dded2-82d9-4140-a0f1-7b6fca24dd41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:35.199259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-a42dded2-82d9-4140-a0f1-7b6fca24dd41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:35.199259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:35.199259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:35.199259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:35.199259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:35.199259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:35.199259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:35.199259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:35.199259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:35.199259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:35.199259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:35.199259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:35.199259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:35.199259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:35.199259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:35.199259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:35.200176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:35.200176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:35.200176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:35.200176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:35.200176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:35.200176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:35.200176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:35.200176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:35.200176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:35.200176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:35.200176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:35.200176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:35.200176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:35.200176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:35.200176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:35.200176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:35.200959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:35.200959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:35.200959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:35.200959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:35.200959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:35.200959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:35.200959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:35.200959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:35.200959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:35.200959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:35.200959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:35.200959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:35.202576 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 83/169] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:35.204695 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dded2-82d9-4140-a0f1-7b6fca24dd41 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:35.332505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 87/170] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 00:13:35.333371 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0ff9e-4a72-4d58-b854-5be47045dc11 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:35.395153 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dded2-82d9-4140-a0f1-7b6fca24dd41 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:35.471217 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:35.483969 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628d983-50c8-4ce6-a490-67603995326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:35.484632 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628d983-50c8-4ce6-a490-67603995326f None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:35.484915 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628d983-50c8-4ce6-a490-67603995326f None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:35.485795 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628d983-50c8-4ce6-a490-67603995326f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:35.507117 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:35.603773 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0ff9e-4a72-4d58-b854-5be47045dc11 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:35.671417 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628d983-50c8-4ce6-a490-67603995326f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:35.673436 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628d983-50c8-4ce6-a490-67603995326f None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:35.683699 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6e794-9aa0-4b2f-87b6-efe40e9607c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:35.684710 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6e794-9aa0-4b2f-87b6-efe40e9607c7 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:35.685186 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6e794-9aa0-4b2f-87b6-efe40e9607c7 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:35.685675 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6e794-9aa0-4b2f-87b6-efe40e9607c7 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:35.686559 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6e794-9aa0-4b2f-87b6-efe40e9607c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:35.687078 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6e794-9aa0-4b2f-87b6-efe40e9607c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:35.689223 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6e794-9aa0-4b2f-87b6-efe40e9607c7 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:35.703015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 88/171] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:35.704209 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6e794-9aa0-4b2f-87b6-efe40e9607c7 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:35.813208 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6e794-9aa0-4b2f-87b6-efe40e9607c7 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:35.832477 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:35.856368 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d79c6-2184-4f71-ad64-51831ddcc666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:35.857429 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d79c6-2184-4f71-ad64-51831ddcc666 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:35.857900 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d79c6-2184-4f71-ad64-51831ddcc666 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:35.858382 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d79c6-2184-4f71-ad64-51831ddcc666 None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:35.859882 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d79c6-2184-4f71-ad64-51831ddcc666 None admin] RBAC: Authorizing `identity:get_project(project_id=10ae72b6264047109854b2e9468e9ba3)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:35.862295 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d79c6-2184-4f71-ad64-51831ddcc666 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:35.864342 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 89/172] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:35 2022] GET /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:35.865534 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d79c6-2184-4f71-ad64-51831ddcc666 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:35.885338 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 84/173] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:13:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:13:35.886212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628d983-50c8-4ce6-a490-67603995326f None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:35.979328 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:35.982981 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d79c6-2184-4f71-ad64-51831ddcc666 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:36.022430 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64bc0f-2178-4fae-bdc7-ca44f02865d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:36.023431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64bc0f-2178-4fae-bdc7-ca44f02865d7 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:36.023717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64bc0f-2178-4fae-bdc7-ca44f02865d7 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:36.023994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64bc0f-2178-4fae-bdc7-ca44f02865d7 None admin] PATH_INFO: `/v3/users/7ff34784d9634d5bb6512d1ca036719d` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:36.025398 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64bc0f-2178-4fae-bdc7-ca44f02865d7 None admin] RBAC: Authorizing `identity:get_user(user_id=7ff34784d9634d5bb6512d1ca036719d)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:36.027666 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64bc0f-2178-4fae-bdc7-ca44f02865d7 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:36.029811 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 90/174] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:35 2022] GET /identity/v3/users/7ff34784d9634d5bb6512d1ca036719d => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:36.030755 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64bc0f-2178-4fae-bdc7-ca44f02865d7 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:36.072727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628d983-50c8-4ce6-a490-67603995326f None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:36.109963 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:36.112143 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d343f26-6773-4bea-99c2-e1fa4b15235b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:36.113274 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d343f26-6773-4bea-99c2-e1fa4b15235b None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:36.113783 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d343f26-6773-4bea-99c2-e1fa4b15235b None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:36.114288 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d343f26-6773-4bea-99c2-e1fa4b15235b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:36.115271 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d343f26-6773-4bea-99c2-e1fa4b15235b None admin] RBAC: Adding query filter params (role.id=9b372d4fe82a4a54a3ecd29e7b912586, scope.project.id=10ae72b6264047109854b2e9468e9ba3, user.id=ba9622273acc4179a07cafb4c9699780) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:36.115784 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d343f26-6773-4bea-99c2-e1fa4b15235b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:36.118248 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d343f26-6773-4bea-99c2-e1fa4b15235b None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:36.125834 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 85/175] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:13:35 2022] GET /identity/v3/role_assignments?user.id=ba9622273acc4179a07cafb4c9699780&scope.project.id=10ae72b6264047109854b2e9468e9ba3&role.id=9b372d4fe82a4a54a3ecd29e7b912586 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:36.131517 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c62a98-0f68-4a97-b11a-0f97a3932ebc None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:36.132087 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c62a98-0f68-4a97-b11a-0f97a3932ebc None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:36.132562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c62a98-0f68-4a97-b11a-0f97a3932ebc None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:36.134437 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 86/176] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:36.139647 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c62a98-0f68-4a97-b11a-0f97a3932ebc None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:36.165400 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64bc0f-2178-4fae-bdc7-ca44f02865d7 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:36.255848 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fbc7b-2448-4835-8cb2-55188b9495ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:36.256412 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fbc7b-2448-4835-8cb2-55188b9495ec None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:36.256696 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fbc7b-2448-4835-8cb2-55188b9495ec None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:36.256973 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fbc7b-2448-4835-8cb2-55188b9495ec None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:36.259446 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fbc7b-2448-4835-8cb2-55188b9495ec None admin] RBAC: Authorizing `identity:get_project(project_id=10ae72b6264047109854b2e9468e9ba3)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:36.259787 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fbc7b-2448-4835-8cb2-55188b9495ec None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:36.261638 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 91/177] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:36 2022] GET /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:36.262635 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47bbde-3b03-44ca-ad8a-ddfcf7bfbd17 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:36.263932 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47bbde-3b03-44ca-ad8a-ddfcf7bfbd17 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:36.263932 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47bbde-3b03-44ca-ad8a-ddfcf7bfbd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:36.300691 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-8a47bbde-3b03-44ca-ad8a-ddfcf7bfbd17 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:36.303563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-8a47bbde-3b03-44ca-ad8a-ddfcf7bfbd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:36.341647 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c62a98-0f68-4a97-b11a-0f97a3932ebc None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:36.343837 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:36.415038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff844c48-3b08-421e-8e58-85c085d7dfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:36.416087 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff844c48-3b08-421e-8e58-85c085d7dfab None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:36.416623 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff844c48-3b08-421e-8e58-85c085d7dfab None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:36.417106 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff844c48-3b08-421e-8e58-85c085d7dfab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:36.505648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 92/178] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:36.506457 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47bbde-3b03-44ca-ad8a-ddfcf7bfbd17 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:36.596214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff844c48-3b08-421e-8e58-85c085d7dfab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:36.598341 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff844c48-3b08-421e-8e58-85c085d7dfab None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:36.651809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:36.755796 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47bbde-3b03-44ca-ad8a-ddfcf7bfbd17 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:36.815709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acfcff-f5a3-4031-a2ed-fbcde6cbef5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:36.816324 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acfcff-f5a3-4031-a2ed-fbcde6cbef5b None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:36.816435 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 87/179] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:13:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:13:36.816676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acfcff-f5a3-4031-a2ed-fbcde6cbef5b None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:36.816871 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acfcff-f5a3-4031-a2ed-fbcde6cbef5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:36.817597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acfcff-f5a3-4031-a2ed-fbcde6cbef5b None admin] RBAC: Adding query filter params (role.id=a7db20dbcb4b458d932c564bc9ad5bfb, scope.project.id=10ae72b6264047109854b2e9468e9ba3, user.id=7ff34784d9634d5bb6512d1ca036719d) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:36.817706 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba2f93-5f3f-44ed-a5c3-3408b50b3120 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:36.817902 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acfcff-f5a3-4031-a2ed-fbcde6cbef5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:36.818005 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba2f93-5f3f-44ed-a5c3-3408b50b3120 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:36.818215 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba2f93-5f3f-44ed-a5c3-3408b50b3120 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:36.819389 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acfcff-f5a3-4031-a2ed-fbcde6cbef5b None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:36.823671 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 88/180] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:36.824796 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9354373-37d5-4ad4-b7b7-bdb58bc50a38 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:36.825080 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9354373-37d5-4ad4-b7b7-bdb58bc50a38 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:36.825355 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9354373-37d5-4ad4-b7b7-bdb58bc50a38 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:36.826593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 89/181] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:36.828979 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9354373-37d5-4ad4-b7b7-bdb58bc50a38 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:36.831412 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 93/182] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:13:36 2022] GET /identity/v3/role_assignments?user.id=7ff34784d9634d5bb6512d1ca036719d&scope.project.id=10ae72b6264047109854b2e9468e9ba3&role.id=a7db20dbcb4b458d932c564bc9ad5bfb => generated 608 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:36.832954 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:36.833064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b1232-fb92-454b-8069-8e6e4c52c2b8 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:36.833154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b1232-fb92-454b-8069-8e6e4c52c2b8 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:36.833420 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b1232-fb92-454b-8069-8e6e4c52c2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:36.862719 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-f64b1232-fb92-454b-8069-8e6e4c52c2b8 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:36.864275 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-f64b1232-fb92-454b-8069-8e6e4c52c2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:36.966407 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 94/183] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:36.968250 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20a5e6-b138-4c71-8238-dde470b1f364 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:36.968750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20a5e6-b138-4c71-8238-dde470b1f364 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:36.969212 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20a5e6-b138-4c71-8238-dde470b1f364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:36.995070 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-8c20a5e6-b138-4c71-8238-dde470b1f364 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:36.996619 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-8c20a5e6-b138-4c71-8238-dde470b1f364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:37.013166 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9354373-37d5-4ad4-b7b7-bdb58bc50a38 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:37.052908 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0de924-940b-45f9-91e2-05a010c84541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:37.053544 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0de924-940b-45f9-91e2-05a010c84541 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:37.053825 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0de924-940b-45f9-91e2-05a010c84541 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:37.054097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0de924-940b-45f9-91e2-05a010c84541 None admin] PATH_INFO: `/v3/projects/9be5188191974ffc810922498327a37b` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:37.055304 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0de924-940b-45f9-91e2-05a010c84541 None admin] RBAC: Authorizing `identity:get_project(project_id=9be5188191974ffc810922498327a37b)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:37.056986 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0de924-940b-45f9-91e2-05a010c84541 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:37.058893 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 90/184] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:36 2022] GET /identity/v3/projects/9be5188191974ffc810922498327a37b => generated 312 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:37.059703 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0de924-940b-45f9-91e2-05a010c84541 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:37.073942 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:37.131846 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 95/185] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:37.132732 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20a5e6-b138-4c71-8238-dde470b1f364 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:37.174101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:37.196605 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0de924-940b-45f9-91e2-05a010c84541 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:37.235563 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41088f72-d15e-4ad4-be15-759799ce726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:37.236196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41088f72-d15e-4ad4-be15-759799ce726a None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:37.236476 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41088f72-d15e-4ad4-be15-759799ce726a None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:37.236750 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41088f72-d15e-4ad4-be15-759799ce726a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:37.247941 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41088f72-d15e-4ad4-be15-759799ce726a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:37.251589 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20a5e6-b138-4c71-8238-dde470b1f364 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:37.254018 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-41088f72-d15e-4ad4-be15-759799ce726a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:13:37.254018 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:37.254018 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:37.254018 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:37.254018 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:37.254018 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:37.254018 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:37.254018 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:37.254018 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:37.254018 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:37.254018 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:37.254018 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:37.254018 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:37.254018 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:37.254018 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:37.254018 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:37.254980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:37.254980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:37.254980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:37.254980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:37.254980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:37.254980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:37.254980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:37.254980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:37.254980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:37.254980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:37.254980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:37.254980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:37.254980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:37.254980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:37.254980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:37.254980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:37.256069 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:37.256069 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:37.256069 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:37.256069 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:37.256069 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:37.256069 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:37.256069 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:37.256069 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:37.256069 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:37.256069 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:37.256069 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:13:37.256069 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:37.256069 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 91/186] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 00:13:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:37.262857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41088f72-d15e-4ad4-be15-759799ce726a None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:37.293790 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add5e4-4556-40cd-bbeb-ff4e8798f903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:37.294736 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add5e4-4556-40cd-bbeb-ff4e8798f903 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:37.295211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add5e4-4556-40cd-bbeb-ff4e8798f903 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:37.295664 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add5e4-4556-40cd-bbeb-ff4e8798f903 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:37.296635 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42add5e4-4556-40cd-bbeb-ff4e8798f903 None admin] RBAC: Adding query filter params (role.id=3fe3a1eb546b456aa3c8bce846a8d37f, scope.project.id=9be5188191974ffc810922498327a37b, user.id=7ff34784d9634d5bb6512d1ca036719d) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:37.297128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42add5e4-4556-40cd-bbeb-ff4e8798f903 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:37.298907 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42add5e4-4556-40cd-bbeb-ff4e8798f903 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:37.305459 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 96/187] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:13:37 2022] GET /identity/v3/role_assignments?user.id=7ff34784d9634d5bb6512d1ca036719d&scope.project.id=9be5188191974ffc810922498327a37b&role.id=3fe3a1eb546b456aa3c8bce846a8d37f => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:37.368208 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add5e4-4556-40cd-bbeb-ff4e8798f903 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:37.423905 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41088f72-d15e-4ad4-be15-759799ce726a None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:37.453292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:37.480323 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f13b2-20b4-4b7f-a06f-a87c3064dfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:37.480887 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f13b2-20b4-4b7f-a06f-a87c3064dfb8 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:37.481236 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f13b2-20b4-4b7f-a06f-a87c3064dfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:37.481520 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f13b2-20b4-4b7f-a06f-a87c3064dfb8 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:37.482207 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f13b2-20b4-4b7f-a06f-a87c3064dfb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:37.482516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f13b2-20b4-4b7f-a06f-a87c3064dfb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:37.483384 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:37.485951 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f13b2-20b4-4b7f-a06f-a87c3064dfb8 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:37.503033 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 92/188] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:37.512163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f13b2-20b4-4b7f-a06f-a87c3064dfb8 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:37.539939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add5e4-4556-40cd-bbeb-ff4e8798f903 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:37.576620 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb5f34-2df4-4ff1-8f61-0efe6af03259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:37.577068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb5f34-2df4-4ff1-8f61-0efe6af03259 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:37.577345 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb5f34-2df4-4ff1-8f61-0efe6af03259 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:37.577613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb5f34-2df4-4ff1-8f61-0efe6af03259 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:37.592342 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb5f34-2df4-4ff1-8f61-0efe6af03259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:37.598378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-34cb5f34-2df4-4ff1-8f61-0efe6af03259 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:13:37.598378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:37.598378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:37.598378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:37.598378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:37.598378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:37.598378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:37.598378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:37.598378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:37.598378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:37.598378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:37.598378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:37.598378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:37.598378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:37.598378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:37.598378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:37.599519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:37.599519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:37.599519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:37.599519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:37.599519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:37.599519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:37.599519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:37.599519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:37.599519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:37.599519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:37.599519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:37.599519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:37.599519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:37.599519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:37.599519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:37.599519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:37.600296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:37.600296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:37.600296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:37.600296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:37.600296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:37.600296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:37.600296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:37.600296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:37.600296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:37.600296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:37.600296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:13:37.600296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:13:37.600296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 97/189] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:13:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:37.606773 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb5f34-2df4-4ff1-8f61-0efe6af03259 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:37.639329 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f13b2-20b4-4b7f-a06f-a87c3064dfb8 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:37.680268 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195def1b-96b0-4387-87cb-40b133b3b9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:37.681376 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195def1b-96b0-4387-87cb-40b133b3b9f8 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:37.681917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195def1b-96b0-4387-87cb-40b133b3b9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:37.682436 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195def1b-96b0-4387-87cb-40b133b3b9f8 None admin] PATH_INFO: `/v3/users/8cbe8e936e0f480084f8d07a32cd807f` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:37.697941 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195def1b-96b0-4387-87cb-40b133b3b9f8 None admin] RBAC: Authorizing `identity:get_user(user_id=8cbe8e936e0f480084f8d07a32cd807f)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:37.699770 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195def1b-96b0-4387-87cb-40b133b3b9f8 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:37.701976 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 93/190] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:37 2022] GET /identity/v3/users/8cbe8e936e0f480084f8d07a32cd807f => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:37.709146 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195def1b-96b0-4387-87cb-40b133b3b9f8 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:37.723132 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:37.726949 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb5f34-2df4-4ff1-8f61-0efe6af03259 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:37.763754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f76e05-5490-45ff-98de-2c5cb783a19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:37.764366 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f76e05-5490-45ff-98de-2c5cb783a19b None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:37.764647 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f76e05-5490-45ff-98de-2c5cb783a19b None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:37.764918 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f76e05-5490-45ff-98de-2c5cb783a19b None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:37.765592 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f76e05-5490-45ff-98de-2c5cb783a19b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:37.766042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f76e05-5490-45ff-98de-2c5cb783a19b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:37.767887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f76e05-5490-45ff-98de-2c5cb783a19b None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:37.771355 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:37.776583 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 98/191] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:13:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:37.777229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f76e05-5490-45ff-98de-2c5cb783a19b None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:37.823581 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195def1b-96b0-4387-87cb-40b133b3b9f8 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:37.861659 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac8b20-3c95-4c38-9e4b-3de70be7364e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:37.862269 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac8b20-3c95-4c38-9e4b-3de70be7364e None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:37.862553 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac8b20-3c95-4c38-9e4b-3de70be7364e None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:37.862828 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac8b20-3c95-4c38-9e4b-3de70be7364e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:37.894724 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f76e05-5490-45ff-98de-2c5cb783a19b None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:37.935479 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9e707-2bf8-41f9-b98c-aa39696675af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:37.936054 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9e707-2bf8-41f9-b98c-aa39696675af None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:37.936336 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9e707-2bf8-41f9-b98c-aa39696675af None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:37.936614 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9e707-2bf8-41f9-b98c-aa39696675af None admin] PATH_INFO: `/v3/domains/default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:37.937732 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9e707-2bf8-41f9-b98c-aa39696675af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:37.939263 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9e707-2bf8-41f9-b98c-aa39696675af None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:37.943267 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 99/192] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:13:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:37.943267 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9e707-2bf8-41f9-b98c-aa39696675af None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:37.944416 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac8b20-3c95-4c38-9e4b-3de70be7364e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:37.946021 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac8b20-3c95-4c38-9e4b-3de70be7364e None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:37.983458 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:38.001724 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:38.059871 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 94/193] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:13:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:13:38.061113 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac8b20-3c95-4c38-9e4b-3de70be7364e None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:38.070598 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9e707-2bf8-41f9-b98c-aa39696675af None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:38.108420 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766621b3-d10f-46d9-baa6-37b3a788f2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:38.109042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766621b3-d10f-46d9-baa6-37b3a788f2c9 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:38.109318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766621b3-d10f-46d9-baa6-37b3a788f2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:38.109589 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766621b3-d10f-46d9-baa6-37b3a788f2c9 None admin] PATH_INFO: `/v3/users/8cbe8e936e0f480084f8d07a32cd807f` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:38.111077 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766621b3-d10f-46d9-baa6-37b3a788f2c9 None admin] RBAC: Authorizing `identity:get_user(user_id=8cbe8e936e0f480084f8d07a32cd807f)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:38.112516 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766621b3-d10f-46d9-baa6-37b3a788f2c9 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:38.114085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 100/194] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:37 2022] GET /identity/v3/users/8cbe8e936e0f480084f8d07a32cd807f => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:38.118850 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766621b3-d10f-46d9-baa6-37b3a788f2c9 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:38.166521 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac8b20-3c95-4c38-9e4b-3de70be7364e None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:38.201220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c3f16-34d8-4c69-b482-b27575d5f2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:38.201859 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c3f16-34d8-4c69-b482-b27575d5f2f9 None admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:38.202095 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c3f16-34d8-4c69-b482-b27575d5f2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:38.202372 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c3f16-34d8-4c69-b482-b27575d5f2f9 None admin] PATH_INFO: `/v3/users` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:38.203047 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c3f16-34d8-4c69-b482-b27575d5f2f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:38.205937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c3f16-34d8-4c69-b482-b27575d5f2f9 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:38.212667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:38.216928 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766621b3-d10f-46d9-baa6-37b3a788f2c9 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:38.226938 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 95/195] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 00:13:38 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:13:38.228318 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db34a4c-1fee-487f-a302-900d1623a276 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:38.228606 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db34a4c-1fee-487f-a302-900d1623a276 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:38.228878 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db34a4c-1fee-487f-a302-900d1623a276 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:38.230142 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 96/196] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:38.230852 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db34a4c-1fee-487f-a302-900d1623a276 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:38.242445 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:38.271945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e004c-b9b8-4bb7-84e3-642a7261e2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:38.272703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e004c-b9b8-4bb7-84e3-642a7261e2be None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:38.273083 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e004c-b9b8-4bb7-84e3-642a7261e2be None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:38.273365 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e004c-b9b8-4bb7-84e3-642a7261e2be None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:38.274533 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e004c-b9b8-4bb7-84e3-642a7261e2be None admin] RBAC: Authorizing `identity:get_project(project_id=60965deec4684d2f95fd5e6ebac6f77c)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:38.276046 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e004c-b9b8-4bb7-84e3-642a7261e2be None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:38.283181 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 101/197] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:38 2022] GET /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:38.283181 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bac0a-b5a2-4ed7-b372-8c7e8cdcbf85 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:38.283181 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bac0a-b5a2-4ed7-b372-8c7e8cdcbf85 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:38.283181 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bac0a-b5a2-4ed7-b372-8c7e8cdcbf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:38.300551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-2f2bac0a-b5a2-4ed7-b372-8c7e8cdcbf85 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:38.301782 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-2f2bac0a-b5a2-4ed7-b372-8c7e8cdcbf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:38.368694 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db34a4c-1fee-487f-a302-900d1623a276 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:38.382773 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 102/198] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:38.383640 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bac0a-b5a2-4ed7-b372-8c7e8cdcbf85 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:38.423914 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685779c-5ad8-41e7-888b-c7d7a2883303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:38.424454 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685779c-5ad8-41e7-888b-c7d7a2883303 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:38.424734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685779c-5ad8-41e7-888b-c7d7a2883303 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:38.425343 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685779c-5ad8-41e7-888b-c7d7a2883303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:38.520813 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:38.522607 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685779c-5ad8-41e7-888b-c7d7a2883303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:38.524357 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685779c-5ad8-41e7-888b-c7d7a2883303 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:38.529144 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bac0a-b5a2-4ed7-b372-8c7e8cdcbf85 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:38.535066 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:38.581372 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da95aba-3a53-412a-bdb4-29c6eac7593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:38.582298 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da95aba-3a53-412a-bdb4-29c6eac7593a None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:38.582298 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da95aba-3a53-412a-bdb4-29c6eac7593a None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:38.582572 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da95aba-3a53-412a-bdb4-29c6eac7593a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:38.583306 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da95aba-3a53-412a-bdb4-29c6eac7593a None admin] RBAC: Adding query filter params (role.id=9b372d4fe82a4a54a3ecd29e7b912586, scope.project.id=60965deec4684d2f95fd5e6ebac6f77c, user.id=8cbe8e936e0f480084f8d07a32cd807f) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:38.583612 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da95aba-3a53-412a-bdb4-29c6eac7593a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:38.585068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da95aba-3a53-412a-bdb4-29c6eac7593a None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:38.593012 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 103/199] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:13:38 2022] GET /identity/v3/role_assignments?user.id=8cbe8e936e0f480084f8d07a32cd807f&scope.project.id=60965deec4684d2f95fd5e6ebac6f77c&role.id=9b372d4fe82a4a54a3ecd29e7b912586 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:38.655882 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 97/200] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:13:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:13:38.661893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da95aba-3a53-412a-bdb4-29c6eac7593a None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:38.754128 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685779c-5ad8-41e7-888b-c7d7a2883303 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:38.802770 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da95aba-3a53-412a-bdb4-29c6eac7593a None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:38.851899 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67598704-8597-4390-86e8-ebf338c88400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:38.852852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67598704-8597-4390-86e8-ebf338c88400 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:38.853397 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67598704-8597-4390-86e8-ebf338c88400 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:38.853678 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67598704-8597-4390-86e8-ebf338c88400 None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:38.854819 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67598704-8597-4390-86e8-ebf338c88400 None admin] RBAC: Authorizing `identity:get_project(project_id=60965deec4684d2f95fd5e6ebac6f77c)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:38.856458 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67598704-8597-4390-86e8-ebf338c88400 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:38.859078 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 104/201] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:38 2022] GET /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:38.865670 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67598704-8597-4390-86e8-ebf338c88400 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:38.902368 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:38.903194 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685779c-5ad8-41e7-888b-c7d7a2883303 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:38.912730 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:38.951474 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f92170-9d36-4616-be30-5c222827d299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:38.953415 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f92170-9d36-4616-be30-5c222827d299 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:38.954646 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f92170-9d36-4616-be30-5c222827d299 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:38.955156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f92170-9d36-4616-be30-5c222827d299 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:38.971653 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f92170-9d36-4616-be30-5c222827d299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:38.977393 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-54f92170-9d36-4616-be30-5c222827d299 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:13:38.977393 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:38.977393 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:38.977393 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:38.977393 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:38.977393 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:38.977393 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:38.977393 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:38.977393 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:38.977393 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:38.977393 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:38.977393 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:38.977393 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:38.977393 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:38.977393 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:38.977393 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:38.978362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:38.978362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:38.978362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:38.978362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:38.978362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:38.978362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:38.978362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:38.978362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:38.978362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:38.978362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:38.978362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:38.978362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:38.978362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:38.978362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:38.978362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:38.978362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:38.979568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:38.979568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:38.979568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:38.979568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:38.979568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:38.979568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:38.979568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:38.979568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:38.979568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:38.979568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:38.979568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:13:38.979568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:38.981620 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 98/202] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:13:38.988347 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f92170-9d36-4616-be30-5c222827d299 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:39.033828 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67598704-8597-4390-86e8-ebf338c88400 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:39.090400 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64479501-676b-4e13-a890-4e94c0a14737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:39.090815 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64479501-676b-4e13-a890-4e94c0a14737 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:39.091143 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64479501-676b-4e13-a890-4e94c0a14737 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:39.091418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64479501-676b-4e13-a890-4e94c0a14737 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:39.092158 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64479501-676b-4e13-a890-4e94c0a14737 None admin] RBAC: Adding query filter params (role.id=a7db20dbcb4b458d932c564bc9ad5bfb, scope.project.id=60965deec4684d2f95fd5e6ebac6f77c, user.id=8cbe8e936e0f480084f8d07a32cd807f) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:39.092475 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64479501-676b-4e13-a890-4e94c0a14737 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:39.099147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64479501-676b-4e13-a890-4e94c0a14737 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:39.100279 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 105/203] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:13:38 2022] GET /identity/v3/role_assignments?user.id=8cbe8e936e0f480084f8d07a32cd807f&scope.project.id=60965deec4684d2f95fd5e6ebac6f77c&role.id=a7db20dbcb4b458d932c564bc9ad5bfb => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:39.165533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f92170-9d36-4616-be30-5c222827d299 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:39.217178 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da5645-8cc3-47ee-8396-67a9e242cb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:39.218630 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da5645-8cc3-47ee-8396-67a9e242cb3e None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:39.219189 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da5645-8cc3-47ee-8396-67a9e242cb3e None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:39.220250 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da5645-8cc3-47ee-8396-67a9e242cb3e None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:39.221127 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da5645-8cc3-47ee-8396-67a9e242cb3e None admin] RBAC: Adding query filter params (name=reader) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:39.221707 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da5645-8cc3-47ee-8396-67a9e242cb3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:39.223362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da5645-8cc3-47ee-8396-67a9e242cb3e None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:39.233641 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 99/204] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:39.239539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64479501-676b-4e13-a890-4e94c0a14737 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:39.370227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:39.379931 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64479501-676b-4e13-a890-4e94c0a14737 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:39.422577 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd2977-6d4a-4b3b-9652-ac6303fc7e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:39.423249 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd2977-6d4a-4b3b-9652-ac6303fc7e8a None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:39.423711 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd2977-6d4a-4b3b-9652-ac6303fc7e8a None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:39.423994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd2977-6d4a-4b3b-9652-ac6303fc7e8a None admin] PATH_INFO: `/v3/users/b1fd014e97f94c81827a0d803f3e93b3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:39.425152 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd2977-6d4a-4b3b-9652-ac6303fc7e8a None admin] RBAC: Authorizing `identity:get_user(user_id=b1fd014e97f94c81827a0d803f3e93b3)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:39.426620 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd2977-6d4a-4b3b-9652-ac6303fc7e8a None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:39.428253 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 106/205] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:39 2022] GET /identity/v3/users/b1fd014e97f94c81827a0d803f3e93b3 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:39.434068 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da5645-8cc3-47ee-8396-67a9e242cb3e None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:39.466374 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:39.570599 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da5645-8cc3-47ee-8396-67a9e242cb3e None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:39.619970 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2eb28a-7dd6-4b53-bf50-c6a1d25b885c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:39.620645 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2eb28a-7dd6-4b53-bf50-c6a1d25b885c None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:39.620876 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2eb28a-7dd6-4b53-bf50-c6a1d25b885c None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:39.621151 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2eb28a-7dd6-4b53-bf50-c6a1d25b885c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:39.710698 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2eb28a-7dd6-4b53-bf50-c6a1d25b885c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:39.712243 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2eb28a-7dd6-4b53-bf50-c6a1d25b885c None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:39.743429 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:39.821766 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 100/206] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:13:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:13:39.828119 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd2977-6d4a-4b3b-9652-ac6303fc7e8a None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:39.949163 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd2977-6d4a-4b3b-9652-ac6303fc7e8a None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:39.987302 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213495b4-1802-44c6-b91e-19d8238f7b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:39.987934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213495b4-1802-44c6-b91e-19d8238f7b7c None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:39.988215 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213495b4-1802-44c6-b91e-19d8238f7b7c None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:39.988488 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213495b4-1802-44c6-b91e-19d8238f7b7c None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:39.989624 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213495b4-1802-44c6-b91e-19d8238f7b7c None admin] RBAC: Authorizing `identity:get_project(project_id=10ae72b6264047109854b2e9468e9ba3)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:39.991116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213495b4-1802-44c6-b91e-19d8238f7b7c None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:39.993493 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 107/207] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:39 2022] GET /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:39.999377 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2eb28a-7dd6-4b53-bf50-c6a1d25b885c None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:40.130304 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2eb28a-7dd6-4b53-bf50-c6a1d25b885c None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:40.161483 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:40.169933 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b458746-8431-4cd4-86b2-f51a92008e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:40.170540 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b458746-8431-4cd4-86b2-f51a92008e37 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:40.170822 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b458746-8431-4cd4-86b2-f51a92008e37 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:40.171129 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b458746-8431-4cd4-86b2-f51a92008e37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:40.171921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b458746-8431-4cd4-86b2-f51a92008e37 None admin] RBAC: Adding query filter params (role.id=4eba322b310a4c6a8962dfb897571cf3, scope.project.id=10ae72b6264047109854b2e9468e9ba3, user.id=b1fd014e97f94c81827a0d803f3e93b3) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:40.172175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b458746-8431-4cd4-86b2-f51a92008e37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:40.173653 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b458746-8431-4cd4-86b2-f51a92008e37 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:40.179807 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 101/208] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:13:39 2022] GET /identity/v3/role_assignments?user.id=b1fd014e97f94c81827a0d803f3e93b3&scope.project.id=10ae72b6264047109854b2e9468e9ba3&role.id=4eba322b310a4c6a8962dfb897571cf3 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:41.075956 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838bf55-43bb-4404-8e06-a58e0c25f3c7 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:41.076871 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f6310-3a8c-4938-bc1a-b3e054c396b6 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:41.076871 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f6310-3a8c-4938-bc1a-b3e054c396b6 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:41.077458 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f6310-3a8c-4938-bc1a-b3e054c396b6 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:41.077947 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838bf55-43bb-4404-8e06-a58e0c25f3c7 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:41.079158 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 102/209] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:41.079494 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838bf55-43bb-4404-8e06-a58e0c25f3c7 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:41.081127 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 108/210] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:41.085054 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994230dc-7381-4b56-8ee6-6ea27ded0dad None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:41.085355 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994230dc-7381-4b56-8ee6-6ea27ded0dad None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:41.085741 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994230dc-7381-4b56-8ee6-6ea27ded0dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:41.087360 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b9fcf-dc2c-49c6-b7dd-fecbfe6ce814 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:41.087861 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b9fcf-dc2c-49c6-b7dd-fecbfe6ce814 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:41.088353 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b9fcf-dc2c-49c6-b7dd-fecbfe6ce814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:41.104352 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-994230dc-7381-4b56-8ee6-6ea27ded0dad None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:41.105551 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-994230dc-7381-4b56-8ee6-6ea27ded0dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:41.107243 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-9e7b9fcf-dc2c-49c6-b7dd-fecbfe6ce814 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:41.108586 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-9e7b9fcf-dc2c-49c6-b7dd-fecbfe6ce814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:41.133492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:41.186333 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 103/211] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:41.193348 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 109/212] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:13:41.233648 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec0471-d6b2-4f4d-8ec4-bdf61c042578 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:41.233974 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec0471-d6b2-4f4d-8ec4-bdf61c042578 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:41.234209 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec0471-d6b2-4f4d-8ec4-bdf61c042578 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:41.235890 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 104/213] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:41.241211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fd986-6258-4f51-af40-0f3dc7620133 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:41.241483 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fd986-6258-4f51-af40-0f3dc7620133 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:41.241748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fd986-6258-4f51-af40-0f3dc7620133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:41.260425 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-b27fd986-6258-4f51-af40-0f3dc7620133 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:41.261602 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-b27fd986-6258-4f51-af40-0f3dc7620133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:41.335187 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 110/214] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:41.523504 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec0471-d6b2-4f4d-8ec4-bdf61c042578 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:41.529124 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fd986-6258-4f51-af40-0f3dc7620133 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:41.633986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:41.645944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec0471-d6b2-4f4d-8ec4-bdf61c042578 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:41.651381 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fd986-6258-4f51-af40-0f3dc7620133 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:41.671698 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:41.685715 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41117f4a-303b-48ac-8aff-1e2a33724f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:41.686503 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41117f4a-303b-48ac-8aff-1e2a33724f8f None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:41.686781 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41117f4a-303b-48ac-8aff-1e2a33724f8f None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:41.687094 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41117f4a-303b-48ac-8aff-1e2a33724f8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:41.688274 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41117f4a-303b-48ac-8aff-1e2a33724f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:41.689753 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41117f4a-303b-48ac-8aff-1e2a33724f8f None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:41.691991 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 105/215] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:13:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:41.692833 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41117f4a-303b-48ac-8aff-1e2a33724f8f None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:41.700883 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a40598-b5d0-4580-bbd0-c15f43028211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:41.701990 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a40598-b5d0-4580-bbd0-c15f43028211 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:41.702272 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a40598-b5d0-4580-bbd0-c15f43028211 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:41.702543 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a40598-b5d0-4580-bbd0-c15f43028211 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:41.715448 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a40598-b5d0-4580-bbd0-c15f43028211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:41.720858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-e4a40598-b5d0-4580-bbd0-c15f43028211 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:13:41.720858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:41.720858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:41.720858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:41.720858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:41.720858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:41.720858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:41.720858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:41.720858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:41.720858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:41.720858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:41.720858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:41.720858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:41.720858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:41.720858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:41.720858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:41.721940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:41.721940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:41.721940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:41.721940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:41.721940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:41.721940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:41.721940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:41.721940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:41.721940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:41.721940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:41.721940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:41.721940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:41.721940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:41.721940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:41.721940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:41.721940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:41.722784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:41.722784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:41.722784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:41.722784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:41.722784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:41.722784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:41.722784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:41.722784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:41.722784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:41.722784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:41.722784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:13:41.722784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:13:41.722784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 111/216] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 00:13:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:13:41.723479 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a40598-b5d0-4580-bbd0-c15f43028211 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:41.811559 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41117f4a-303b-48ac-8aff-1e2a33724f8f None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:41.829809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a40598-b5d0-4580-bbd0-c15f43028211 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:41.852649 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53613f-efc5-4211-938f-4eaa345a0bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:41.853281 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53613f-efc5-4211-938f-4eaa345a0bb9 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:41.853557 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53613f-efc5-4211-938f-4eaa345a0bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:41.853821 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53613f-efc5-4211-938f-4eaa345a0bb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:41.865554 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53613f-efc5-4211-938f-4eaa345a0bb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:41.866568 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a64d5-d8f4-4ba8-be75-79573fb72550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:41.867198 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a64d5-d8f4-4ba8-be75-79573fb72550 None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:41.867476 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a64d5-d8f4-4ba8-be75-79573fb72550 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:41.867747 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a64d5-d8f4-4ba8-be75-79573fb72550 None admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:41.868382 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a64d5-d8f4-4ba8-be75-79573fb72550 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:41.869825 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a64d5-d8f4-4ba8-be75-79573fb72550 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:41.870337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-3e53613f-efc5-4211-938f-4eaa345a0bb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:41.870337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:41.870337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:41.870337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:41.870337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:41.870337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:41.870337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:41.870337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:41.870337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:41.870337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:41.870337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:41.870337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:41.870337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:41.870337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:41.870337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:41.870337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:41.871212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:41.871212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:41.871212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:41.871212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:41.871212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:41.871212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:41.871212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:41.871212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:41.871212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:41.871212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:41.871212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:41.871212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:41.871212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:41.871212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:41.871212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:41.871212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:41.872019 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:41.872019 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:41.872019 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:41.872019 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:41.872019 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:41.872019 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:41.872019 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:41.872019 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:41.872019 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:41.872019 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:41.872019 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:41.872019 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:41.872019 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 106/217] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:41.877397 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53613f-efc5-4211-938f-4eaa345a0bb9 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:41.903171 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 112/218] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 00:13:41 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:13:41.903171 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a64d5-d8f4-4ba8-be75-79573fb72550 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:41.903171 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:41.940981 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:42.004755 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53613f-efc5-4211-938f-4eaa345a0bb9 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:42.044164 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a64d5-d8f4-4ba8-be75-79573fb72550 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:42.045108 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f700bee-e71e-46f9-9d7f-6461dc1faba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:42.045736 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f700bee-e71e-46f9-9d7f-6461dc1faba1 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:42.046020 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f700bee-e71e-46f9-9d7f-6461dc1faba1 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:42.046298 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f700bee-e71e-46f9-9d7f-6461dc1faba1 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:42.046987 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f700bee-e71e-46f9-9d7f-6461dc1faba1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:42.047366 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f700bee-e71e-46f9-9d7f-6461dc1faba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:42.048803 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f700bee-e71e-46f9-9d7f-6461dc1faba1 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:42.062597 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 107/219] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:42.062597 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6a6e2-eb2e-48d5-887e-b49a032faebc None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:42.062597 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6a6e2-eb2e-48d5-887e-b49a032faebc None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:42.062597 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6a6e2-eb2e-48d5-887e-b49a032faebc None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:42.062597 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 108/220] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:42.067313 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6a6e2-eb2e-48d5-887e-b49a032faebc None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:42.094791 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f684d37-5f77-42cf-9f87-94b1a2f40fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:42.095449 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f684d37-5f77-42cf-9f87-94b1a2f40fbc None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:42.095793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f684d37-5f77-42cf-9f87-94b1a2f40fbc None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:42.096076 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f684d37-5f77-42cf-9f87-94b1a2f40fbc None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:42.096752 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f684d37-5f77-42cf-9f87-94b1a2f40fbc None admin] RBAC: Adding query filter params (name=member) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:42.097059 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f684d37-5f77-42cf-9f87-94b1a2f40fbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:42.098443 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f684d37-5f77-42cf-9f87-94b1a2f40fbc None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:42.107382 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 113/221] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:42.115540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c26b38-2680-42d6-8f40-5763a794b318 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:42.115896 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c26b38-2680-42d6-8f40-5763a794b318 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:42.116209 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c26b38-2680-42d6-8f40-5763a794b318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:42.139340 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-e0c26b38-2680-42d6-8f40-5763a794b318 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:42.140634 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-e0c26b38-2680-42d6-8f40-5763a794b318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:42.194344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6a6e2-eb2e-48d5-887e-b49a032faebc None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:42.211830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:42.217465 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:42.227907 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 114/222] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:42.228764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c26b38-2680-42d6-8f40-5763a794b318 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:42.240484 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c47fe-c562-451d-a68b-47cc77c17736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:42.240791 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c47fe-c562-451d-a68b-47cc77c17736 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:42.241167 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c47fe-c562-451d-a68b-47cc77c17736 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:42.241444 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c47fe-c562-451d-a68b-47cc77c17736 None admin] PATH_INFO: `/v3/users/8cbe8e936e0f480084f8d07a32cd807f` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:42.242987 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c47fe-c562-451d-a68b-47cc77c17736 None admin] RBAC: Authorizing `identity:get_user(user_id=8cbe8e936e0f480084f8d07a32cd807f)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:42.244206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c47fe-c562-451d-a68b-47cc77c17736 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:42.246093 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 109/223] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:42 2022] GET /identity/v3/users/8cbe8e936e0f480084f8d07a32cd807f => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:42.251325 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c47fe-c562-451d-a68b-47cc77c17736 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:42.356483 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c26b38-2680-42d6-8f40-5763a794b318 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:42.398621 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c47fe-c562-451d-a68b-47cc77c17736 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:42.398812 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0371f-33b3-4e0b-9c37-01be4ee065b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:42.399425 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0371f-33b3-4e0b-9c37-01be4ee065b3 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:42.399704 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0371f-33b3-4e0b-9c37-01be4ee065b3 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:42.399980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0371f-33b3-4e0b-9c37-01be4ee065b3 None admin] PATH_INFO: `/v3/users/040cdd6b54f1463fb5251188699f91fc` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:42.414874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0371f-33b3-4e0b-9c37-01be4ee065b3 None admin] RBAC: Authorizing `identity:get_user(user_id=040cdd6b54f1463fb5251188699f91fc)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:42.416560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0371f-33b3-4e0b-9c37-01be4ee065b3 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:42.418667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 115/224] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:42 2022] GET /identity/v3/users/040cdd6b54f1463fb5251188699f91fc => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:42.424226 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0371f-33b3-4e0b-9c37-01be4ee065b3 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:42.457102 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd2caf-092f-4cdb-b2b8-ad7dda232a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:42.457661 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd2caf-092f-4cdb-b2b8-ad7dda232a29 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:42.457947 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd2caf-092f-4cdb-b2b8-ad7dda232a29 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:42.458227 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd2caf-092f-4cdb-b2b8-ad7dda232a29 None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:42.465162 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd2caf-092f-4cdb-b2b8-ad7dda232a29 None admin] RBAC: Authorizing `identity:get_project(project_id=60965deec4684d2f95fd5e6ebac6f77c)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:42.468078 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd2caf-092f-4cdb-b2b8-ad7dda232a29 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:42.472972 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 110/225] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:42 2022] GET /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:42.477044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd2caf-092f-4cdb-b2b8-ad7dda232a29 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:42.539455 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:42.583361 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:42.614723 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0371f-33b3-4e0b-9c37-01be4ee065b3 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:42.673148 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd2caf-092f-4cdb-b2b8-ad7dda232a29 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:42.681866 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3bd828-e450-4c78-b23d-e9bb3aabe4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:42.682804 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bd828-e450-4c78-b23d-e9bb3aabe4aa None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:42.683355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bd828-e450-4c78-b23d-e9bb3aabe4aa None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:42.683893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bd828-e450-4c78-b23d-e9bb3aabe4aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:42.711105 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b74d2-39e8-40c7-96e0-7ef5b26c7d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:42.711697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b74d2-39e8-40c7-96e0-7ef5b26c7d3d None admin] REQUEST_METHOD: `PUT` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:42.711980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b74d2-39e8-40c7-96e0-7ef5b26c7d3d None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:42.712259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b74d2-39e8-40c7-96e0-7ef5b26c7d3d None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c/users/8cbe8e936e0f480084f8d07a32cd807f/roles/9b372d4fe82a4a54a3ecd29e7b912586` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:42.714528 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b74d2-39e8-40c7-96e0-7ef5b26c7d3d None admin] RBAC: Authorizing `identity:create_grant(project_id=60965deec4684d2f95fd5e6ebac6f77c, user_id=8cbe8e936e0f480084f8d07a32cd807f, role_id=9b372d4fe82a4a54a3ecd29e7b912586)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:42.716122 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b74d2-39e8-40c7-96e0-7ef5b26c7d3d None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:42.736635 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 111/226] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 00:13:42 2022] PUT /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c/users/8cbe8e936e0f480084f8d07a32cd807f/roles/9b372d4fe82a4a54a3ecd29e7b912586 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:13:42.737937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b74d2-39e8-40c7-96e0-7ef5b26c7d3d None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:42.802534 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3bd828-e450-4c78-b23d-e9bb3aabe4aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:42.804297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3bd828-e450-4c78-b23d-e9bb3aabe4aa None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:42.868644 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b74d2-39e8-40c7-96e0-7ef5b26c7d3d None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:42.881189 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:42.916320 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f50977-6773-4650-8ea2-a73e766415a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:42.917619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f50977-6773-4650-8ea2-a73e766415a9 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:42.918096 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f50977-6773-4650-8ea2-a73e766415a9 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:42.918582 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f50977-6773-4650-8ea2-a73e766415a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:42.932085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f50977-6773-4650-8ea2-a73e766415a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:42.938512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-19f50977-6773-4650-8ea2-a73e766415a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:13:42.938512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:42.938512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:42.938512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:42.938512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:42.938512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:42.938512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:42.938512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:42.938512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:42.938512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:42.938512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:42.938512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:42.938512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:42.938512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:42.938512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:42.938512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:42.939509 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:42.939509 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:42.939509 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:42.939509 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:42.939509 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:42.939509 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:42.939509 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:42.939509 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:42.939509 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:42.939509 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:42.939509 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:42.939509 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:42.939509 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:42.939509 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:42.939509 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:42.939509 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:42.940570 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:42.940570 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:42.940570 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:42.940570 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:42.940570 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:42.940570 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:42.940570 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:42.940570 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:42.940570 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:42.940570 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:42.940570 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:13:42.940570 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:42.943748 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 112/227] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:13:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:42.950449 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f50977-6773-4650-8ea2-a73e766415a9 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:42.954735 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:43.033667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 116/228] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:13:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:13:43.039293 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3bd828-e450-4c78-b23d-e9bb3aabe4aa None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:43.070936 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f50977-6773-4650-8ea2-a73e766415a9 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:43.107267 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe00ab3-7f1c-4112-9e40-2f07590a5bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:43.107828 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe00ab3-7f1c-4112-9e40-2f07590a5bc6 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:43.108188 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe00ab3-7f1c-4112-9e40-2f07590a5bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:43.108463 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe00ab3-7f1c-4112-9e40-2f07590a5bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:43.109127 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe00ab3-7f1c-4112-9e40-2f07590a5bc6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:43.109499 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe00ab3-7f1c-4112-9e40-2f07590a5bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:43.112059 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe00ab3-7f1c-4112-9e40-2f07590a5bc6 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:43.121201 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 113/229] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:13:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:43.127161 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe00ab3-7f1c-4112-9e40-2f07590a5bc6 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:43.153868 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3bd828-e450-4c78-b23d-e9bb3aabe4aa None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:43.160116 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:43.195609 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f796834-0e72-4114-b948-d898a2ec85a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:43.196736 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f796834-0e72-4114-b948-d898a2ec85a4 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:43.197293 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f796834-0e72-4114-b948-d898a2ec85a4 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:43.197762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f796834-0e72-4114-b948-d898a2ec85a4 None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:43.199156 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f796834-0e72-4114-b948-d898a2ec85a4 None admin] RBAC: Authorizing `identity:get_project(project_id=60965deec4684d2f95fd5e6ebac6f77c)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:43.200914 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f796834-0e72-4114-b948-d898a2ec85a4 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:43.202976 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 117/230] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:43 2022] GET /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:43.211996 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f796834-0e72-4114-b948-d898a2ec85a4 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:43.238009 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe00ab3-7f1c-4112-9e40-2f07590a5bc6 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:43.274665 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:43.276839 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222211d-0063-4aa7-a23f-c6213fd7c141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:43.278270 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222211d-0063-4aa7-a23f-c6213fd7c141 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:43.278545 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222211d-0063-4aa7-a23f-c6213fd7c141 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:43.279581 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222211d-0063-4aa7-a23f-c6213fd7c141 None admin] PATH_INFO: `/v3/users/8cbe8e936e0f480084f8d07a32cd807f` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:43.282657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222211d-0063-4aa7-a23f-c6213fd7c141 None admin] RBAC: Authorizing `identity:get_user(user_id=8cbe8e936e0f480084f8d07a32cd807f)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:43.285003 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222211d-0063-4aa7-a23f-c6213fd7c141 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:43.286654 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 114/231] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:43 2022] GET /identity/v3/users/8cbe8e936e0f480084f8d07a32cd807f => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:43.296434 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222211d-0063-4aa7-a23f-c6213fd7c141 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:43.442474 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f796834-0e72-4114-b948-d898a2ec85a4 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:43.498450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:43.504365 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222211d-0063-4aa7-a23f-c6213fd7c141 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:43.519616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d1539-ffc1-46ec-958a-c4a24f0408a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:43.520296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d1539-ffc1-46ec-958a-c4a24f0408a7 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:43.520577 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d1539-ffc1-46ec-958a-c4a24f0408a7 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:43.520849 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d1539-ffc1-46ec-958a-c4a24f0408a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:43.521583 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d1539-ffc1-46ec-958a-c4a24f0408a7 None admin] RBAC: Adding query filter params (role.id=3fe3a1eb546b456aa3c8bce846a8d37f, scope.project.id=60965deec4684d2f95fd5e6ebac6f77c, user.id=040cdd6b54f1463fb5251188699f91fc) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:43.521893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d1539-ffc1-46ec-958a-c4a24f0408a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:43.529033 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d1539-ffc1-46ec-958a-c4a24f0408a7 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:43.536047 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 118/232] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:13:43 2022] GET /identity/v3/role_assignments?user.id=040cdd6b54f1463fb5251188699f91fc&scope.project.id=60965deec4684d2f95fd5e6ebac6f77c&role.id=3fe3a1eb546b456aa3c8bce846a8d37f => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:43.556065 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253bd0f-ee1a-4b24-8b72-61347f255128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:43.556758 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253bd0f-ee1a-4b24-8b72-61347f255128 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:43.557037 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253bd0f-ee1a-4b24-8b72-61347f255128 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:43.557363 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253bd0f-ee1a-4b24-8b72-61347f255128 None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:43.558591 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253bd0f-ee1a-4b24-8b72-61347f255128 None admin] RBAC: Authorizing `identity:get_project(project_id=60965deec4684d2f95fd5e6ebac6f77c)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:43.560122 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253bd0f-ee1a-4b24-8b72-61347f255128 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:43.562197 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 115/233] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:43 2022] GET /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:43.568442 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d1539-ffc1-46ec-958a-c4a24f0408a7 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:43.688940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d1539-ffc1-46ec-958a-c4a24f0408a7 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:43.711417 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:43.746573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c2ea0-bc80-4d72-8096-06c5b13223fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:43.747267 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c2ea0-bc80-4d72-8096-06c5b13223fc None admin] REQUEST_METHOD: `PUT` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:43.747543 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c2ea0-bc80-4d72-8096-06c5b13223fc None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:43.747814 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c2ea0-bc80-4d72-8096-06c5b13223fc None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c/users/8cbe8e936e0f480084f8d07a32cd807f/roles/a7db20dbcb4b458d932c564bc9ad5bfb` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:43.750109 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c2ea0-bc80-4d72-8096-06c5b13223fc None admin] RBAC: Authorizing `identity:create_grant(project_id=60965deec4684d2f95fd5e6ebac6f77c, user_id=8cbe8e936e0f480084f8d07a32cd807f, role_id=a7db20dbcb4b458d932c564bc9ad5bfb)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:43.751693 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c2ea0-bc80-4d72-8096-06c5b13223fc None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:43.775694 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 119/234] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 00:13:43 2022] PUT /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c/users/8cbe8e936e0f480084f8d07a32cd807f/roles/a7db20dbcb4b458d932c564bc9ad5bfb => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:13:44.620677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d603ccd-6e60-4632-9256-cca3486846f3 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:44.621197 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d603ccd-6e60-4632-9256-cca3486846f3 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:44.621197 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d603ccd-6e60-4632-9256-cca3486846f3 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:44.622546 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 116/235] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:44.628652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b913d-a01c-4bf8-b5c3-936670a9d073 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:44.629036 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b913d-a01c-4bf8-b5c3-936670a9d073 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:44.629196 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b913d-a01c-4bf8-b5c3-936670a9d073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:44.660249 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-c38b913d-a01c-4bf8-b5c3-936670a9d073 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:44.661427 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-c38b913d-a01c-4bf8-b5c3-936670a9d073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:44.749902 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 120/236] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:13:44.788471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f158e-dadc-4409-a61a-4ecaf5ae3a68 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:44.788826 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f158e-dadc-4409-a61a-4ecaf5ae3a68 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:44.789167 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f158e-dadc-4409-a61a-4ecaf5ae3a68 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:44.790954 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 117/237] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:44.808907 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc009910-82a5-4d8c-9bcf-798c2d1c99e5 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:44.809251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc009910-82a5-4d8c-9bcf-798c2d1c99e5 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:44.809523 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc009910-82a5-4d8c-9bcf-798c2d1c99e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:44.840032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-fc009910-82a5-4d8c-9bcf-798c2d1c99e5 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:44.841251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-fc009910-82a5-4d8c-9bcf-798c2d1c99e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:44.929611 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 121/238] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:45.093025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f158e-dadc-4409-a61a-4ecaf5ae3a68 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:45.200530 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f158e-dadc-4409-a61a-4ecaf5ae3a68 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:45.247925 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad30bf3-378d-4bbd-a9ed-d3e18b6b6cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:45.248559 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad30bf3-378d-4bbd-a9ed-d3e18b6b6cfe None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:45.248840 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad30bf3-378d-4bbd-a9ed-d3e18b6b6cfe None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:45.249117 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad30bf3-378d-4bbd-a9ed-d3e18b6b6cfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:45.255654 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad30bf3-378d-4bbd-a9ed-d3e18b6b6cfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:45.257120 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad30bf3-378d-4bbd-a9ed-d3e18b6b6cfe None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:45.258711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 118/239] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:13:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:45.264087 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc009910-82a5-4d8c-9bcf-798c2d1c99e5 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:45.273711 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:45.395938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc009910-82a5-4d8c-9bcf-798c2d1c99e5 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:45.442885 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa35352-0ccd-4334-9d3f-8770ce828386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:45.443535 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa35352-0ccd-4334-9d3f-8770ce828386 None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:45.443821 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa35352-0ccd-4334-9d3f-8770ce828386 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:45.444096 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa35352-0ccd-4334-9d3f-8770ce828386 None admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:45.444766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa35352-0ccd-4334-9d3f-8770ce828386 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:45.446357 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa35352-0ccd-4334-9d3f-8770ce828386 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:45.478296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 122/240] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 00:13:45 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:13:45.546792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad30bf3-378d-4bbd-a9ed-d3e18b6b6cfe None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:45.601516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:45.639405 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd104351-5caa-4066-81cf-fd5b8d6578cd None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:45.639909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd104351-5caa-4066-81cf-fd5b8d6578cd None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:45.639983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd104351-5caa-4066-81cf-fd5b8d6578cd None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:45.642479 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 123/241] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:13:45.648647 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd22a8-473e-4222-a78e-066bd5cc5518 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:45.648923 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd22a8-473e-4222-a78e-066bd5cc5518 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:45.649102 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd22a8-473e-4222-a78e-066bd5cc5518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:45.676808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-cdbd22a8-473e-4222-a78e-066bd5cc5518 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:45.679481 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-cdbd22a8-473e-4222-a78e-066bd5cc5518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:45.723630 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad30bf3-378d-4bbd-a9ed-d3e18b6b6cfe None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:45.753359 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:45.770461 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 124/242] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:13:45.773335 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95c5f2-03f4-4e66-a4fc-20a24b377ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:45.774254 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95c5f2-03f4-4e66-a4fc-20a24b377ca6 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:45.774767 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95c5f2-03f4-4e66-a4fc-20a24b377ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:45.775262 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95c5f2-03f4-4e66-a4fc-20a24b377ca6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:45.789861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95c5f2-03f4-4e66-a4fc-20a24b377ca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:45.795477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-cf95c5f2-03f4-4e66-a4fc-20a24b377ca6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:13:45.795477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:45.795477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:45.795477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:45.795477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:45.795477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:45.795477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:45.795477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:45.795477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:45.795477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:45.795477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:45.795477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:45.795477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:45.795477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:45.795477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:45.795477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:45.796469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:45.796469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:45.796469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:45.796469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:45.796469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:45.796469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:45.796469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:45.796469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:45.796469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:45.796469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:45.796469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:45.796469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:45.796469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:45.796469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:45.796469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:45.796469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:45.797523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:45.797523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:45.797523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:45.797523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:45.797523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:45.797523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:45.797523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:45.797523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:45.797523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:45.797523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:45.797523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:13:45.797523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:45.799537 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 119/243] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:45.805957 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd22a8-473e-4222-a78e-066bd5cc5518 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:45.915328 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd22a8-473e-4222-a78e-066bd5cc5518 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:45.953175 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d273319-be08-4c3c-831c-8dc1e427aaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:45.954669 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d273319-be08-4c3c-831c-8dc1e427aaf0 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:45.955195 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d273319-be08-4c3c-831c-8dc1e427aaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:45.955683 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d273319-be08-4c3c-831c-8dc1e427aaf0 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:45.956547 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d273319-be08-4c3c-831c-8dc1e427aaf0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:45.957041 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d273319-be08-4c3c-831c-8dc1e427aaf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:45.958614 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d273319-be08-4c3c-831c-8dc1e427aaf0 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:45.969830 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 125/244] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:45.974953 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95c5f2-03f4-4e66-a4fc-20a24b377ca6 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:46.084252 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:46.096376 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95c5f2-03f4-4e66-a4fc-20a24b377ca6 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:46.137258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3ab57-893e-4681-bae6-71ed79fd264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:46.138283 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3ab57-893e-4681-bae6-71ed79fd264f None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:46.138784 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3ab57-893e-4681-bae6-71ed79fd264f None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:46.139344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3ab57-893e-4681-bae6-71ed79fd264f None admin] PATH_INFO: `/v3/users/843e2c62200c41f4a30288ac69844640` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:46.155446 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d273319-be08-4c3c-831c-8dc1e427aaf0 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:46.160913 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3ab57-893e-4681-bae6-71ed79fd264f None admin] RBAC: Authorizing `identity:get_user(user_id=843e2c62200c41f4a30288ac69844640)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:46.162983 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3ab57-893e-4681-bae6-71ed79fd264f None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:46.164641 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 120/245] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:45 2022] GET /identity/v3/users/843e2c62200c41f4a30288ac69844640 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:46.170289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3ab57-893e-4681-bae6-71ed79fd264f None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:46.244474 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:46.310845 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d273319-be08-4c3c-831c-8dc1e427aaf0 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:46.320103 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3ab57-893e-4681-bae6-71ed79fd264f None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:46.355785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d40f5-8a82-47d2-843a-a31e28a3407c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:46.356431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d40f5-8a82-47d2-843a-a31e28a3407c None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:46.356710 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d40f5-8a82-47d2-843a-a31e28a3407c None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:46.356982 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d40f5-8a82-47d2-843a-a31e28a3407c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:46.368198 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f327c-2cc0-4af9-8b7f-d1874648efbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:46.368813 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f327c-2cc0-4af9-8b7f-d1874648efbb None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:46.369094 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f327c-2cc0-4af9-8b7f-d1874648efbb None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:46.369368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f327c-2cc0-4af9-8b7f-d1874648efbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:46.370436 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d40f5-8a82-47d2-843a-a31e28a3407c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:46.376524 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-899d40f5-8a82-47d2-843a-a31e28a3407c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:13:46.376524 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:46.376524 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:46.376524 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:46.376524 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:46.376524 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:46.376524 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:46.376524 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:46.376524 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:46.376524 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:46.376524 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:46.376524 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:46.376524 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:46.376524 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:46.376524 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:46.376524 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:46.377520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:46.377520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:46.377520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:46.377520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:46.377520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:46.377520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:46.377520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:46.377520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:46.377520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:46.377520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:46.377520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:46.377520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:46.377520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:46.377520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:46.377520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:46.377520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:46.378337 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:46.378337 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:46.378337 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:46.378337 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:46.378337 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:46.378337 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:46.378337 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:46.378337 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:46.378337 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:46.378337 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:46.378337 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:13:46.378337 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:13:46.378337 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 126/246] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 00:13:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:46.379028 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f105e-146e-46ff-a9fc-36e7a1c68f0f None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:46.379102 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f105e-146e-46ff-a9fc-36e7a1c68f0f None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:46.380193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f105e-146e-46ff-a9fc-36e7a1c68f0f None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:46.380826 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 127/247] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:46.385029 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f105e-146e-46ff-a9fc-36e7a1c68f0f None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:46.399387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:46.447615 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f327c-2cc0-4af9-8b7f-d1874648efbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:46.449198 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f327c-2cc0-4af9-8b7f-d1874648efbb None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:46.523480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f105e-146e-46ff-a9fc-36e7a1c68f0f None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:46.541043 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:46.562308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 121/248] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:13:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:13:46.567366 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ada8e7-7952-4a9b-b226-250df4bdbfa7 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:46.567366 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ada8e7-7952-4a9b-b226-250df4bdbfa7 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:46.567366 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ada8e7-7952-4a9b-b226-250df4bdbfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:46.570660 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba8ff8-30ab-44c2-966e-57e815c8a0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:46.571681 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba8ff8-30ab-44c2-966e-57e815c8a0a5 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:46.572163 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba8ff8-30ab-44c2-966e-57e815c8a0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:46.572665 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba8ff8-30ab-44c2-966e-57e815c8a0a5 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:46.573537 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba8ff8-30ab-44c2-966e-57e815c8a0a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:46.574056 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba8ff8-30ab-44c2-966e-57e815c8a0a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:46.575972 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba8ff8-30ab-44c2-966e-57e815c8a0a5 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:46.587379 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 128/249] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:46.588666 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba8ff8-30ab-44c2-966e-57e815c8a0a5 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:46.604029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-b5ada8e7-7952-4a9b-b226-250df4bdbfa7 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:46.605300 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-b5ada8e7-7952-4a9b-b226-250df4bdbfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:46.705513 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:46.709253 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba8ff8-30ab-44c2-966e-57e815c8a0a5 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:46.731208 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 122/250] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:46.731907 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ada8e7-7952-4a9b-b226-250df4bdbfa7 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:46.763421 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10a68a-a7b9-498c-9f07-cf91384e89f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:46.764406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10a68a-a7b9-498c-9f07-cf91384e89f6 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:46.764935 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10a68a-a7b9-498c-9f07-cf91384e89f6 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:46.765471 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10a68a-a7b9-498c-9f07-cf91384e89f6 None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:46.771741 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10a68a-a7b9-498c-9f07-cf91384e89f6 None admin] RBAC: Authorizing `identity:get_project(project_id=60965deec4684d2f95fd5e6ebac6f77c)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:46.773665 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10a68a-a7b9-498c-9f07-cf91384e89f6 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:46.776364 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 129/251] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:46 2022] GET /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:46.777813 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28141ae3-42c0-4537-ba1d-742d62f7f1ef None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:46.778294 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28141ae3-42c0-4537-ba1d-742d62f7f1ef None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:46.778827 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28141ae3-42c0-4537-ba1d-742d62f7f1ef None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:46.785659 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 130/252] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:46.787668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d01582-44fc-482a-b3ea-a494d10a2751 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:46.788207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d01582-44fc-482a-b3ea-a494d10a2751 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:46.788680 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d01582-44fc-482a-b3ea-a494d10a2751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:46.824017 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-12d01582-44fc-482a-b3ea-a494d10a2751 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:46.825579 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-12d01582-44fc-482a-b3ea-a494d10a2751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:46.843178 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ada8e7-7952-4a9b-b226-250df4bdbfa7 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:46.880711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fc8a3-9535-4174-9c38-747b0e5f4595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:46.882410 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fc8a3-9535-4174-9c38-747b0e5f4595 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:46.882757 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fc8a3-9535-4174-9c38-747b0e5f4595 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:46.883053 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fc8a3-9535-4174-9c38-747b0e5f4595 None admin] PATH_INFO: `/v3/users/8cbe8e936e0f480084f8d07a32cd807f` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:46.891214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fc8a3-9535-4174-9c38-747b0e5f4595 None admin] RBAC: Authorizing `identity:get_user(user_id=8cbe8e936e0f480084f8d07a32cd807f)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:46.891214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fc8a3-9535-4174-9c38-747b0e5f4595 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:46.891214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 123/253] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:46 2022] GET /identity/v3/users/8cbe8e936e0f480084f8d07a32cd807f => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:46.891214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fc8a3-9535-4174-9c38-747b0e5f4595 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:46.907576 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:46.948418 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:46.961668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 131/254] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:46.962478 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d01582-44fc-482a-b3ea-a494d10a2751 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:47.003813 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fc8a3-9535-4174-9c38-747b0e5f4595 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:47.067744 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3b6e6-52e1-4433-a6f3-71615aaa6173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:47.068376 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3b6e6-52e1-4433-a6f3-71615aaa6173 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:47.068724 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3b6e6-52e1-4433-a6f3-71615aaa6173 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:47.069145 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3b6e6-52e1-4433-a6f3-71615aaa6173 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:47.069981 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3b6e6-52e1-4433-a6f3-71615aaa6173 None admin] RBAC: Adding query filter params (role.id=4eba322b310a4c6a8962dfb897571cf3, scope.project.id=60965deec4684d2f95fd5e6ebac6f77c, user.id=843e2c62200c41f4a30288ac69844640) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:47.070290 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3b6e6-52e1-4433-a6f3-71615aaa6173 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:47.071934 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3b6e6-52e1-4433-a6f3-71615aaa6173 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:47.085317 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 124/255] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:13:46 2022] GET /identity/v3/role_assignments?user.id=843e2c62200c41f4a30288ac69844640&scope.project.id=60965deec4684d2f95fd5e6ebac6f77c&role.id=4eba322b310a4c6a8962dfb897571cf3 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:47.088313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d01582-44fc-482a-b3ea-a494d10a2751 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:47.125975 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06394bf-d2a6-44b6-9fda-a28ac9e63229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:47.126608 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06394bf-d2a6-44b6-9fda-a28ac9e63229 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:47.126885 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06394bf-d2a6-44b6-9fda-a28ac9e63229 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:47.127187 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06394bf-d2a6-44b6-9fda-a28ac9e63229 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:47.175367 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:47.204120 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06394bf-d2a6-44b6-9fda-a28ac9e63229 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:47.206091 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06394bf-d2a6-44b6-9fda-a28ac9e63229 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:47.248179 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3b6e6-52e1-4433-a6f3-71615aaa6173 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:47.316048 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 132/256] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:13:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:13:47.321552 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06394bf-d2a6-44b6-9fda-a28ac9e63229 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:47.401142 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:47.428645 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06394bf-d2a6-44b6-9fda-a28ac9e63229 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:47.436790 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3b6e6-52e1-4433-a6f3-71615aaa6173 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:47.464983 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:47.467545 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5266cdb-9ebb-4de1-bdbf-60f214bb4101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:47.468185 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5266cdb-9ebb-4de1-bdbf-60f214bb4101 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:47.468466 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5266cdb-9ebb-4de1-bdbf-60f214bb4101 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:47.468759 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5266cdb-9ebb-4de1-bdbf-60f214bb4101 None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:47.470601 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5266cdb-9ebb-4de1-bdbf-60f214bb4101 None admin] RBAC: Authorizing `identity:get_project(project_id=60965deec4684d2f95fd5e6ebac6f77c)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:47.472208 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5266cdb-9ebb-4de1-bdbf-60f214bb4101 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:47.474257 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 133/257] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:47 2022] GET /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:47.480568 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5266cdb-9ebb-4de1-bdbf-60f214bb4101 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:47.522693 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeef9bc-1310-48ef-969c-b2ee2b07871e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:47.523381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeef9bc-1310-48ef-969c-b2ee2b07871e None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:47.523663 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeef9bc-1310-48ef-969c-b2ee2b07871e None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:47.523938 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeef9bc-1310-48ef-969c-b2ee2b07871e None admin] PATH_INFO: `/v3/roles/member` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:47.554862 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeef9bc-1310-48ef-969c-b2ee2b07871e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:47.559684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-3eeef9bc-1310-48ef-969c-b2ee2b07871e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:47.559684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:47.559684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:47.559684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:47.559684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:47.559684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:47.559684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:47.559684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:47.559684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:47.559684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:47.559684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:47.559684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:47.559684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:47.559684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:47.559684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:47.559684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:47.560568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:47.560568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:47.560568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:47.560568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:47.560568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:47.560568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:47.560568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:47.560568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:47.560568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:47.560568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:47.560568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:47.560568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:47.560568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:47.560568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:47.560568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:47.560568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:47.561361 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:47.561361 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:47.561361 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:47.561361 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:47.561361 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:47.561361 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:47.561361 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:47.561361 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:47.561361 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:47.561361 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:47.561361 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:47.561361 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:47.561361 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 125/258] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:47.572003 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeef9bc-1310-48ef-969c-b2ee2b07871e None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:47.595156 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5266cdb-9ebb-4de1-bdbf-60f214bb4101 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:47.640990 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfeede-5c32-4353-bb88-05375337fc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:47.641631 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfeede-5c32-4353-bb88-05375337fc37 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:47.642250 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfeede-5c32-4353-bb88-05375337fc37 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:47.642379 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfeede-5c32-4353-bb88-05375337fc37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:47.643221 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfeede-5c32-4353-bb88-05375337fc37 None admin] RBAC: Adding query filter params (role.id=9b372d4fe82a4a54a3ecd29e7b912586, scope.project.id=60965deec4684d2f95fd5e6ebac6f77c, user.id=8cbe8e936e0f480084f8d07a32cd807f) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:47.643543 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfeede-5c32-4353-bb88-05375337fc37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:47.645028 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfeede-5c32-4353-bb88-05375337fc37 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:47.664169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 134/259] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:13:47 2022] GET /identity/v3/role_assignments?user.id=8cbe8e936e0f480084f8d07a32cd807f&scope.project.id=60965deec4684d2f95fd5e6ebac6f77c&role.id=9b372d4fe82a4a54a3ecd29e7b912586 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:47.665076 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfeede-5c32-4353-bb88-05375337fc37 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:47.683416 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:47.716775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeef9bc-1310-48ef-969c-b2ee2b07871e None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:47.755449 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d091ac5-049b-414f-ab61-a476fdebb7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:47.756071 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d091ac5-049b-414f-ab61-a476fdebb7d7 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:47.756454 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d091ac5-049b-414f-ab61-a476fdebb7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:47.756623 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d091ac5-049b-414f-ab61-a476fdebb7d7 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:47.757264 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d091ac5-049b-414f-ab61-a476fdebb7d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:47.757567 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d091ac5-049b-414f-ab61-a476fdebb7d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:47.758978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d091ac5-049b-414f-ab61-a476fdebb7d7 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:47.768752 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 126/260] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:47.773969 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d091ac5-049b-414f-ab61-a476fdebb7d7 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:47.823952 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:47.903514 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d091ac5-049b-414f-ab61-a476fdebb7d7 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:47.917078 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfeede-5c32-4353-bb88-05375337fc37 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:47.944336 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3b8ee-c625-48e8-92a7-b4d94e897382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:47.944995 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3b8ee-c625-48e8-92a7-b4d94e897382 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:47.945348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3b8ee-c625-48e8-92a7-b4d94e897382 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:47.945629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3b8ee-c625-48e8-92a7-b4d94e897382 None admin] PATH_INFO: `/v3/users/040cdd6b54f1463fb5251188699f91fc` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:47.946896 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3b8ee-c625-48e8-92a7-b4d94e897382 None admin] RBAC: Authorizing `identity:get_user(user_id=040cdd6b54f1463fb5251188699f91fc)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:47.948652 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3b8ee-c625-48e8-92a7-b4d94e897382 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:47.950697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 127/261] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:47 2022] GET /identity/v3/users/040cdd6b54f1463fb5251188699f91fc => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:47.956035 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3b8ee-c625-48e8-92a7-b4d94e897382 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:48.017369 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b077fe5-e732-4386-ad53-279629cf1e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:48.018061 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b077fe5-e732-4386-ad53-279629cf1e67 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:48.018343 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b077fe5-e732-4386-ad53-279629cf1e67 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:48.019712 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b077fe5-e732-4386-ad53-279629cf1e67 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:48.040040 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b077fe5-e732-4386-ad53-279629cf1e67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:48.046560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-6b077fe5-e732-4386-ad53-279629cf1e67 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:13:48.046560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:48.046560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:48.046560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:48.046560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:48.046560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:48.046560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:48.046560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:48.046560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:48.046560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:48.046560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:48.046560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:48.046560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:48.046560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:48.046560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:48.046560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:48.048075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:48.048075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:48.048075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:48.048075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:48.048075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:48.048075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:48.048075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:48.048075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:48.048075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:48.048075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:48.048075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:48.048075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:48.048075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:48.048075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:48.048075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:48.048075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:48.048862 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:48.048862 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:48.048862 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:48.048862 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:48.048862 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:48.048862 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:48.048862 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:48.048862 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:48.048862 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:48.048862 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:48.048862 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:13:48.048862 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:13:48.048862 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 135/262] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:13:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:48.058835 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b077fe5-e732-4386-ad53-279629cf1e67 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:48.150826 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3b8ee-c625-48e8-92a7-b4d94e897382 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:48.154709 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:48.187478 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:48.217159 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04a147-caf5-4703-9522-b867095e52cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:48.217798 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04a147-caf5-4703-9522-b867095e52cd None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:48.218081 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04a147-caf5-4703-9522-b867095e52cd None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:48.218358 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04a147-caf5-4703-9522-b867095e52cd None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:48.220072 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04a147-caf5-4703-9522-b867095e52cd None admin] RBAC: Authorizing `identity:get_project(project_id=60965deec4684d2f95fd5e6ebac6f77c)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:48.221543 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04a147-caf5-4703-9522-b867095e52cd None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:48.225686 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 128/263] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:47 2022] GET /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:48.228930 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04a147-caf5-4703-9522-b867095e52cd None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:48.254025 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b077fe5-e732-4386-ad53-279629cf1e67 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:48.320061 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa83dc-5dd7-440b-9315-5b106b9a760f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:48.320633 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa83dc-5dd7-440b-9315-5b106b9a760f None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:48.320917 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa83dc-5dd7-440b-9315-5b106b9a760f None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:48.321187 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa83dc-5dd7-440b-9315-5b106b9a760f None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:48.321864 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa83dc-5dd7-440b-9315-5b106b9a760f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:48.322170 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa83dc-5dd7-440b-9315-5b106b9a760f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:48.324460 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa83dc-5dd7-440b-9315-5b106b9a760f None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:48.339660 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 136/264] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:13:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:48.347041 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa83dc-5dd7-440b-9315-5b106b9a760f None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:48.420482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04a147-caf5-4703-9522-b867095e52cd None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:48.493288 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa83dc-5dd7-440b-9315-5b106b9a760f None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:48.532241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1272b-0b8a-4bcb-b847-89d651ce456f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:48.533609 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1272b-0b8a-4bcb-b847-89d651ce456f None admin] REQUEST_METHOD: `PUT` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:48.533900 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1272b-0b8a-4bcb-b847-89d651ce456f None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:48.534182 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1272b-0b8a-4bcb-b847-89d651ce456f None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c/users/040cdd6b54f1463fb5251188699f91fc/roles/3fe3a1eb546b456aa3c8bce846a8d37f` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:48.539343 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:48.539563 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1272b-0b8a-4bcb-b847-89d651ce456f None admin] RBAC: Authorizing `identity:create_grant(project_id=60965deec4684d2f95fd5e6ebac6f77c, user_id=040cdd6b54f1463fb5251188699f91fc, role_id=3fe3a1eb546b456aa3c8bce846a8d37f)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:48.543883 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1272b-0b8a-4bcb-b847-89d651ce456f None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:48.553829 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af8df7-022e-45f8-b72e-d8df179b7253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:48.554557 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af8df7-022e-45f8-b72e-d8df179b7253 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:48.554839 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af8df7-022e-45f8-b72e-d8df179b7253 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:48.555144 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af8df7-022e-45f8-b72e-d8df179b7253 None admin] PATH_INFO: `/v3/users/8cbe8e936e0f480084f8d07a32cd807f` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:48.556495 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af8df7-022e-45f8-b72e-d8df179b7253 None admin] RBAC: Authorizing `identity:get_user(user_id=8cbe8e936e0f480084f8d07a32cd807f)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:48.558116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af8df7-022e-45f8-b72e-d8df179b7253 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:48.560191 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 137/265] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:48 2022] GET /identity/v3/users/8cbe8e936e0f480084f8d07a32cd807f => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:48.569352 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 129/266] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 00:13:48 2022] PUT /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c/users/040cdd6b54f1463fb5251188699f91fc/roles/3fe3a1eb546b456aa3c8bce846a8d37f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:13:48.570282 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af8df7-022e-45f8-b72e-d8df179b7253 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:48.682571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af8df7-022e-45f8-b72e-d8df179b7253 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:48.723598 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b46ef3-24ee-40bf-aeac-bfcfa219342a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:48.724223 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b46ef3-24ee-40bf-aeac-bfcfa219342a None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:48.724505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b46ef3-24ee-40bf-aeac-bfcfa219342a None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:48.724780 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b46ef3-24ee-40bf-aeac-bfcfa219342a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:48.804334 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b46ef3-24ee-40bf-aeac-bfcfa219342a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:48.805928 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b46ef3-24ee-40bf-aeac-bfcfa219342a None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:48.808140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:48.923194 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 138/267] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:13:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:13:48.928335 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1272b-0b8a-4bcb-b847-89d651ce456f None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:48.964117 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:49.014965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4152a-4732-4a78-827c-a9acdf9fd7ab None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:49.015332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4152a-4732-4a78-827c-a9acdf9fd7ab None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:49.015657 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4152a-4732-4a78-827c-a9acdf9fd7ab None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:49.017015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 139/268] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:49.022078 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c48821-faff-4891-a969-76c2a07aa724 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:49.022356 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c48821-faff-4891-a969-76c2a07aa724 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:49.022684 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c48821-faff-4891-a969-76c2a07aa724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:49.055881 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1272b-0b8a-4bcb-b847-89d651ce456f None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:49.058261 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-a4c48821-faff-4891-a969-76c2a07aa724 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:49.059480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-a4c48821-faff-4891-a969-76c2a07aa724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:49.100739 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9c94d-b51e-4ea6-bfff-35b00772836c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:49.101739 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9c94d-b51e-4ea6-bfff-35b00772836c None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:49.102213 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9c94d-b51e-4ea6-bfff-35b00772836c None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:49.102676 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9c94d-b51e-4ea6-bfff-35b00772836c None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:49.104049 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9c94d-b51e-4ea6-bfff-35b00772836c None admin] RBAC: Authorizing `identity:get_project(project_id=60965deec4684d2f95fd5e6ebac6f77c)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:49.105721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9c94d-b51e-4ea6-bfff-35b00772836c None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:49.107603 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 130/269] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:48 2022] GET /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:49.113914 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9c94d-b51e-4ea6-bfff-35b00772836c None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:49.229891 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:49.232330 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 140/270] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:13:49.234072 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9c94d-b51e-4ea6-bfff-35b00772836c None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:49.299885 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdd64f-d0c2-492b-9765-f6334c1520d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:49.300530 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdd64f-d0c2-492b-9765-f6334c1520d4 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:49.300811 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdd64f-d0c2-492b-9765-f6334c1520d4 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:49.301085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdd64f-d0c2-492b-9765-f6334c1520d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:49.301840 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdd64f-d0c2-492b-9765-f6334c1520d4 None admin] RBAC: Adding query filter params (role.id=a7db20dbcb4b458d932c564bc9ad5bfb, scope.project.id=60965deec4684d2f95fd5e6ebac6f77c, user.id=8cbe8e936e0f480084f8d07a32cd807f) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:49.302151 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdd64f-d0c2-492b-9765-f6334c1520d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:49.303670 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdd64f-d0c2-492b-9765-f6334c1520d4 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:49.310488 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 131/271] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:13:49 2022] GET /identity/v3/role_assignments?user.id=8cbe8e936e0f480084f8d07a32cd807f&scope.project.id=60965deec4684d2f95fd5e6ebac6f77c&role.id=a7db20dbcb4b458d932c564bc9ad5bfb => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:49.449960 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c3f2c-3684-40b8-a44a-1a07432acb62 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:49.450344 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c3f2c-3684-40b8-a44a-1a07432acb62 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:49.450515 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c3f2c-3684-40b8-a44a-1a07432acb62 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:49.452240 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 141/272] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:49.457466 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f983c2f-ba59-46bc-bdf8-5f19576944da None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:49.457755 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f983c2f-ba59-46bc-bdf8-5f19576944da None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:49.458036 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f983c2f-ba59-46bc-bdf8-5f19576944da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:49.487786 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-3f983c2f-ba59-46bc-bdf8-5f19576944da None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:49.489003 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-3f983c2f-ba59-46bc-bdf8-5f19576944da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:49.587415 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 132/273] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:49.735746 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c3f2c-3684-40b8-a44a-1a07432acb62 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:49.769145 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:49.877695 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c3f2c-3684-40b8-a44a-1a07432acb62 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:49.921155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e39531-4242-41cf-b99c-d5e010fb0b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:49.922131 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e39531-4242-41cf-b99c-d5e010fb0b90 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:49.922607 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e39531-4242-41cf-b99c-d5e010fb0b90 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:49.923080 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e39531-4242-41cf-b99c-d5e010fb0b90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:49.924978 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e39531-4242-41cf-b99c-d5e010fb0b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:49.927196 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e39531-4242-41cf-b99c-d5e010fb0b90 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:49.929487 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 142/274] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:13:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:49.936577 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f983c2f-ba59-46bc-bdf8-5f19576944da None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:49.943367 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e39531-4242-41cf-b99c-d5e010fb0b90 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:50.046438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:50.054141 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f983c2f-ba59-46bc-bdf8-5f19576944da None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:50.063190 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:50.070801 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e39531-4242-41cf-b99c-d5e010fb0b90 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:50.095980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b77db-f2f2-4c6a-839a-430a97fc30c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:50.096839 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b77db-f2f2-4c6a-839a-430a97fc30c7 None admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:50.097296 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b77db-f2f2-4c6a-839a-430a97fc30c7 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:50.097566 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b77db-f2f2-4c6a-839a-430a97fc30c7 None admin] PATH_INFO: `/v3/users` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:50.098205 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b77db-f2f2-4c6a-839a-430a97fc30c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:50.099830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b77db-f2f2-4c6a-839a-430a97fc30c7 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:50.108254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d736b92-57bb-420e-b422-a585d867dc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:50.108881 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d736b92-57bb-420e-b422-a585d867dc87 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:50.109159 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d736b92-57bb-420e-b422-a585d867dc87 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:50.109435 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d736b92-57bb-420e-b422-a585d867dc87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:50.122236 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d736b92-57bb-420e-b422-a585d867dc87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:50.123610 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 133/275] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 00:13:49 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:13:50.124709 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260a16f-c4e5-4fe4-8637-1a6b48819107 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:50.125595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260a16f-c4e5-4fe4-8637-1a6b48819107 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:50.126068 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260a16f-c4e5-4fe4-8637-1a6b48819107 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:50.131631 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 134/276] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:50.136738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73602a76-4352-4eb9-85bf-798247f1b737 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:50.137075 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73602a76-4352-4eb9-85bf-798247f1b737 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:50.137479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73602a76-4352-4eb9-85bf-798247f1b737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:50.140394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-6d736b92-57bb-420e-b422-a585d867dc87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:50.140394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:50.140394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:50.140394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:50.140394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:50.140394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:50.140394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:50.140394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:50.140394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:50.140394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:50.140394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:50.140394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:50.140394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:50.140394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:50.140394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:50.140394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:50.142008 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:50.142008 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:50.142008 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:50.142008 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:50.142008 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:50.142008 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:50.142008 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:50.142008 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:50.142008 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:50.142008 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:50.142008 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:50.142008 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:50.142008 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:50.142008 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:50.142008 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:50.142008 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:50.143708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:50.143708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:50.143708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:50.143708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:50.143708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:50.143708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:50.143708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:50.143708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:50.143708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:50.143708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:50.143708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:50.143708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:13:50.143708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 143/277] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:50.151070 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d736b92-57bb-420e-b422-a585d867dc87 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:50.161229 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-73602a76-4352-4eb9-85bf-798247f1b737 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:50.162471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-73602a76-4352-4eb9-85bf-798247f1b737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:50.242139 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 135/278] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:13:50.286259 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d736b92-57bb-420e-b422-a585d867dc87 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:50.329293 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3132161-f85d-4501-915f-0d907cd6e6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:50.329827 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3132161-f85d-4501-915f-0d907cd6e6ed None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:50.330173 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3132161-f85d-4501-915f-0d907cd6e6ed None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:50.330451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3132161-f85d-4501-915f-0d907cd6e6ed None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:50.331189 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3132161-f85d-4501-915f-0d907cd6e6ed None admin] RBAC: Adding query filter params (name=member) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:50.331497 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3132161-f85d-4501-915f-0d907cd6e6ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:50.332898 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3132161-f85d-4501-915f-0d907cd6e6ed None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:50.342384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 144/279] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:50.348110 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73602a76-4352-4eb9-85bf-798247f1b737 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:50.446591 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:50.470081 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73602a76-4352-4eb9-85bf-798247f1b737 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:50.506453 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73369a6f-a464-44e3-afcf-aa62d2a2528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:50.507134 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73369a6f-a464-44e3-afcf-aa62d2a2528d None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:50.514936 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73369a6f-a464-44e3-afcf-aa62d2a2528d None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:50.514936 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73369a6f-a464-44e3-afcf-aa62d2a2528d None admin] PATH_INFO: `/v3/users/a0cd062e42cd4af69e84c7041106e706` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:50.542109 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73369a6f-a464-44e3-afcf-aa62d2a2528d None admin] RBAC: Authorizing `identity:get_user(user_id=a0cd062e42cd4af69e84c7041106e706)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:50.543694 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73369a6f-a464-44e3-afcf-aa62d2a2528d None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:50.545466 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 136/280] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:50 2022] GET /identity/v3/users/a0cd062e42cd4af69e84c7041106e706 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:50.552002 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3132161-f85d-4501-915f-0d907cd6e6ed None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:50.576657 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:50.587354 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73369a6f-a464-44e3-afcf-aa62d2a2528d None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:50.680906 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3132161-f85d-4501-915f-0d907cd6e6ed None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:50.730203 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34483e5d-19b8-484e-ae73-f7d8e957c8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:50.730866 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34483e5d-19b8-484e-ae73-f7d8e957c8aa None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:50.731060 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73369a6f-a464-44e3-afcf-aa62d2a2528d None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:50.731193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34483e5d-19b8-484e-ae73-f7d8e957c8aa None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:50.731451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34483e5d-19b8-484e-ae73-f7d8e957c8aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:50.732249 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34483e5d-19b8-484e-ae73-f7d8e957c8aa None admin] RBAC: Adding query filter params (role.id=3fe3a1eb546b456aa3c8bce846a8d37f, user.id=a0cd062e42cd4af69e84c7041106e706, scope.system=all) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:50.732568 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34483e5d-19b8-484e-ae73-f7d8e957c8aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:50.735557 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34483e5d-19b8-484e-ae73-f7d8e957c8aa None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:50.743796 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 145/281] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Aug 24 00:13:50 2022] GET /identity/v3/role_assignments?user.id=a0cd062e42cd4af69e84c7041106e706&scope.system=all&role.id=3fe3a1eb546b456aa3c8bce846a8d37f => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:50.777178 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f56f10-7e7a-47f8-9d04-31afbf13a6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:50.777820 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f56f10-7e7a-47f8-9d04-31afbf13a6c6 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:50.778155 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f56f10-7e7a-47f8-9d04-31afbf13a6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:50.778430 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f56f10-7e7a-47f8-9d04-31afbf13a6c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:50.789906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:50.794519 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f56f10-7e7a-47f8-9d04-31afbf13a6c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:50.800655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-49f56f10-7e7a-47f8-9d04-31afbf13a6c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:13:50.800655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:50.800655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:50.800655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:50.800655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:50.800655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:50.800655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:50.800655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:50.800655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:50.800655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:50.800655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:50.800655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:50.800655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:50.800655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:50.800655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:50.800655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:50.801731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:50.801731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:50.801731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:50.801731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:50.801731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:50.801731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:50.801731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:50.801731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:50.801731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:50.801731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:50.801731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:50.801731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:50.801731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:50.801731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:50.801731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:50.801731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:50.802736 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:50.802736 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:50.802736 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:50.802736 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:50.802736 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:50.802736 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:50.802736 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:50.802736 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:50.802736 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:50.802736 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:50.802736 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:13:50.802736 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:50.805288 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 137/282] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:50.811528 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34483e5d-19b8-484e-ae73-f7d8e957c8aa None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:50.904944 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:50.927030 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34483e5d-19b8-484e-ae73-f7d8e957c8aa None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:50.965057 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b13ce-14e6-4538-a9ec-84ac6feacecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:50.965677 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b13ce-14e6-4538-a9ec-84ac6feacecc None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:50.965954 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b13ce-14e6-4538-a9ec-84ac6feacecc None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:50.966255 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b13ce-14e6-4538-a9ec-84ac6feacecc None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:50.966896 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b13ce-14e6-4538-a9ec-84ac6feacecc None admin] RBAC: Adding query filter params (name=reader) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:50.967229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b13ce-14e6-4538-a9ec-84ac6feacecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:50.969166 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b13ce-14e6-4538-a9ec-84ac6feacecc None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:50.978696 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 146/283] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:50.985196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f56f10-7e7a-47f8-9d04-31afbf13a6c6 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:51.095850 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f56f10-7e7a-47f8-9d04-31afbf13a6c6 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:51.135943 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f632adf-7c49-44c0-9b0d-45201f42cf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:51.136554 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f632adf-7c49-44c0-9b0d-45201f42cf2e None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:51.136836 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f632adf-7c49-44c0-9b0d-45201f42cf2e None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:51.137109 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f632adf-7c49-44c0-9b0d-45201f42cf2e None admin] PATH_INFO: `/v3/users/843e2c62200c41f4a30288ac69844640` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:51.138265 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f632adf-7c49-44c0-9b0d-45201f42cf2e None admin] RBAC: Authorizing `identity:get_user(user_id=843e2c62200c41f4a30288ac69844640)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:51.139773 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f632adf-7c49-44c0-9b0d-45201f42cf2e None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:51.142315 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 138/284] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:50 2022] GET /identity/v3/users/843e2c62200c41f4a30288ac69844640 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:51.148413 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b13ce-14e6-4538-a9ec-84ac6feacecc None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:51.257022 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b13ce-14e6-4538-a9ec-84ac6feacecc None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:51.293021 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b53bb-fdf7-4f44-88df-cf49fbb02180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:51.293686 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b53bb-fdf7-4f44-88df-cf49fbb02180 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:51.294001 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b53bb-fdf7-4f44-88df-cf49fbb02180 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:51.294298 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b53bb-fdf7-4f44-88df-cf49fbb02180 None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:51.295465 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b53bb-fdf7-4f44-88df-cf49fbb02180 None admin] RBAC: Authorizing `identity:get_project(project_id=60965deec4684d2f95fd5e6ebac6f77c)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:51.296949 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b53bb-fdf7-4f44-88df-cf49fbb02180 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:51.298812 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 147/285] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:51 2022] GET /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:51.305271 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b53bb-fdf7-4f44-88df-cf49fbb02180 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:51.306006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9221-803f-4513-8ae9-f5ebd0959398 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:51.306621 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9221-803f-4513-8ae9-f5ebd0959398 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:51.307167 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9221-803f-4513-8ae9-f5ebd0959398 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:51.308976 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 139/286] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:51.315168 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9765901-5d47-4478-8f62-27e836861f75 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:51.315715 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9765901-5d47-4478-8f62-27e836861f75 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:51.316209 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9765901-5d47-4478-8f62-27e836861f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:51.320121 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:51.338448 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-c9765901-5d47-4478-8f62-27e836861f75 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:51.340121 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-c9765901-5d47-4478-8f62-27e836861f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:51.416969 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b53bb-fdf7-4f44-88df-cf49fbb02180 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:51.455880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824aa80-e3b9-401b-b71d-e500333c5081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:51.456601 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824aa80-e3b9-401b-b71d-e500333c5081 None admin] REQUEST_METHOD: `PUT` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:51.456875 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824aa80-e3b9-401b-b71d-e500333c5081 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:51.457142 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824aa80-e3b9-401b-b71d-e500333c5081 None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c/users/843e2c62200c41f4a30288ac69844640/roles/4eba322b310a4c6a8962dfb897571cf3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:51.460468 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824aa80-e3b9-401b-b71d-e500333c5081 None admin] RBAC: Authorizing `identity:create_grant(project_id=60965deec4684d2f95fd5e6ebac6f77c, user_id=843e2c62200c41f4a30288ac69844640, role_id=4eba322b310a4c6a8962dfb897571cf3)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:51.462330 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824aa80-e3b9-401b-b71d-e500333c5081 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:51.467338 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:51.480753 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 140/287] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:13:51.484118 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 148/288] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 00:13:51 2022] PUT /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c/users/843e2c62200c41f4a30288ac69844640/roles/4eba322b310a4c6a8962dfb897571cf3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:13:51.835869 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9765901-5d47-4478-8f62-27e836861f75 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:51.964749 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9765901-5d47-4478-8f62-27e836861f75 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:52.008587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543afaa-ee39-4949-a3c0-dd583bbcd31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:52.009386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543afaa-ee39-4949-a3c0-dd583bbcd31c None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:52.009556 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543afaa-ee39-4949-a3c0-dd583bbcd31c None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:52.009815 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543afaa-ee39-4949-a3c0-dd583bbcd31c None admin] PATH_INFO: `/v3/roles/member` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:52.023854 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543afaa-ee39-4949-a3c0-dd583bbcd31c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:52.028613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-9543afaa-ee39-4949-a3c0-dd583bbcd31c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:52.028613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:52.028613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:52.028613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:52.028613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:52.028613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:52.028613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:52.028613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:52.028613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:52.028613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:52.028613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:52.028613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:52.028613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:52.028613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:52.028613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:52.028613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:52.029475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:52.029475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:52.029475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:52.029475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:52.029475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:52.029475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:52.029475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:52.029475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:52.029475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:52.029475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:52.029475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:52.029475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:52.029475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:52.029475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:52.029475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:52.029475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:52.030657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:52.030657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:52.030657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:52.030657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:52.030657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:52.030657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:52.030657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:52.030657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:52.030657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:52.030657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:52.030657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:52.030657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:52.030657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 141/289] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:52.035696 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824aa80-e3b9-401b-b71d-e500333c5081 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:52.127195 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:52.165908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824aa80-e3b9-401b-b71d-e500333c5081 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:52.211106 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91672adf-818d-47fa-8d71-020cb2c0f1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:52.211714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91672adf-818d-47fa-8d71-020cb2c0f1c6 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:52.211990 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91672adf-818d-47fa-8d71-020cb2c0f1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:52.212265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91672adf-818d-47fa-8d71-020cb2c0f1c6 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:52.212925 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91672adf-818d-47fa-8d71-020cb2c0f1c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:52.213227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91672adf-818d-47fa-8d71-020cb2c0f1c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:52.214596 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91672adf-818d-47fa-8d71-020cb2c0f1c6 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:52.227444 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 149/290] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:52.233308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543afaa-ee39-4949-a3c0-dd583bbcd31c None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:52.307277 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:52.366271 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543afaa-ee39-4949-a3c0-dd583bbcd31c None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:52.417504 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d613f-dab6-4960-afa8-28b31f66126d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:52.418056 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d613f-dab6-4960-afa8-28b31f66126d None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:52.418337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d613f-dab6-4960-afa8-28b31f66126d None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:52.418613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d613f-dab6-4960-afa8-28b31f66126d None admin] PATH_INFO: `/v3/users/040cdd6b54f1463fb5251188699f91fc` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:52.419785 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d613f-dab6-4960-afa8-28b31f66126d None admin] RBAC: Authorizing `identity:get_user(user_id=040cdd6b54f1463fb5251188699f91fc)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:52.421257 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d613f-dab6-4960-afa8-28b31f66126d None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:52.423261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 142/291] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:52 2022] GET /identity/v3/users/040cdd6b54f1463fb5251188699f91fc => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:52.428831 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91672adf-818d-47fa-8d71-020cb2c0f1c6 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:52.561887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91672adf-818d-47fa-8d71-020cb2c0f1c6 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:52.599905 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:52.608254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff78134-fbb9-4946-8633-5aec182ab641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:52.608921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff78134-fbb9-4946-8633-5aec182ab641 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:52.609769 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff78134-fbb9-4946-8633-5aec182ab641 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:52.610052 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff78134-fbb9-4946-8633-5aec182ab641 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:52.699152 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff78134-fbb9-4946-8633-5aec182ab641 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:52.700208 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff78134-fbb9-4946-8633-5aec182ab641 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:52.825243 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 150/292] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:13:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:13:52.831044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d613f-dab6-4960-afa8-28b31f66126d None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:52.990005 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d613f-dab6-4960-afa8-28b31f66126d None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:53.022445 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:53.038020 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f16b09-f012-4636-bed3-ef8437a8c4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:53.038655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f16b09-f012-4636-bed3-ef8437a8c4d5 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:53.038939 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f16b09-f012-4636-bed3-ef8437a8c4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:53.039233 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f16b09-f012-4636-bed3-ef8437a8c4d5 None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:53.043683 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f16b09-f012-4636-bed3-ef8437a8c4d5 None admin] RBAC: Authorizing `identity:get_project(project_id=60965deec4684d2f95fd5e6ebac6f77c)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:53.045171 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f16b09-f012-4636-bed3-ef8437a8c4d5 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:53.047523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 143/293] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:52 2022] GET /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:53.053956 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff78134-fbb9-4946-8633-5aec182ab641 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:53.092020 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:53.108907 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7f88c-6805-4715-9be9-1e2092729d33 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:53.109568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7f88c-6805-4715-9be9-1e2092729d33 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:53.110064 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7f88c-6805-4715-9be9-1e2092729d33 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:53.111680 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 144/294] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:13:53.117186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce45b5-6fd3-4caa-b4a3-d5aa8c8749fe None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:53.117733 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce45b5-6fd3-4caa-b4a3-d5aa8c8749fe None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:53.118211 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce45b5-6fd3-4caa-b4a3-d5aa8c8749fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:53.138051 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-2bce45b5-6fd3-4caa-b4a3-d5aa8c8749fe None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:53.139763 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-2bce45b5-6fd3-4caa-b4a3-d5aa8c8749fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:53.167356 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff78134-fbb9-4946-8633-5aec182ab641 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:53.204360 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8829770-309a-467d-b0dc-28cb4cea459a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:53.205259 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8829770-309a-467d-b0dc-28cb4cea459a None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:53.205667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8829770-309a-467d-b0dc-28cb4cea459a None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:53.206077 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8829770-309a-467d-b0dc-28cb4cea459a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:53.206968 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8829770-309a-467d-b0dc-28cb4cea459a None admin] RBAC: Adding query filter params (role.id=3fe3a1eb546b456aa3c8bce846a8d37f, scope.project.id=60965deec4684d2f95fd5e6ebac6f77c, user.id=040cdd6b54f1463fb5251188699f91fc) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:53.207428 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8829770-309a-467d-b0dc-28cb4cea459a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:53.208997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8829770-309a-467d-b0dc-28cb4cea459a None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:53.216061 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 151/295] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:13:53 2022] GET /identity/v3/role_assignments?user.id=040cdd6b54f1463fb5251188699f91fc&scope.project.id=60965deec4684d2f95fd5e6ebac6f77c&role.id=3fe3a1eb546b456aa3c8bce846a8d37f => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:53.223025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 145/296] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:13:53.424871 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249d948-38bd-4710-9dca-067f64b8bb8b None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:53.425576 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249d948-38bd-4710-9dca-067f64b8bb8b None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:53.426090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249d948-38bd-4710-9dca-067f64b8bb8b None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:53.427993 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 152/297] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:53.433588 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f29c3-9583-4004-9dc5-7a77dde7589b None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:53.434172 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f29c3-9583-4004-9dc5-7a77dde7589b None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:53.434649 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f29c3-9583-4004-9dc5-7a77dde7589b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:53.454323 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-be7f29c3-9583-4004-9dc5-7a77dde7589b None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:53.455941 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-be7f29c3-9583-4004-9dc5-7a77dde7589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:53.536918 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 146/298] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:53.552509 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249d948-38bd-4710-9dca-067f64b8bb8b None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:53.656717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:53.663698 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249d948-38bd-4710-9dca-067f64b8bb8b None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:53.700475 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afc7c9-52a5-4b95-9c3c-f09ddb1bf1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:53.701025 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afc7c9-52a5-4b95-9c3c-f09ddb1bf1ba None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:53.701297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afc7c9-52a5-4b95-9c3c-f09ddb1bf1ba None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:53.701563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afc7c9-52a5-4b95-9c3c-f09ddb1bf1ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:53.702658 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afc7c9-52a5-4b95-9c3c-f09ddb1bf1ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:53.704181 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afc7c9-52a5-4b95-9c3c-f09ddb1bf1ba None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:53.705734 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 153/299] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:13:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:53.711505 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f29c3-9583-4004-9dc5-7a77dde7589b None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:53.770348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:53.830911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f29c3-9583-4004-9dc5-7a77dde7589b None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:53.878295 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b778b-c9e9-4839-97a7-7fc23814dd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:53.879283 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b778b-c9e9-4839-97a7-7fc23814dd62 None admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:53.879801 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b778b-c9e9-4839-97a7-7fc23814dd62 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:53.880271 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b778b-c9e9-4839-97a7-7fc23814dd62 None admin] PATH_INFO: `/v3/groups` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:53.881248 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b778b-c9e9-4839-97a7-7fc23814dd62 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:53.882892 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b778b-c9e9-4839-97a7-7fc23814dd62 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:53.901697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 147/300] 10.222.0.42 () {60 vars in 1134 bytes} [Wed Aug 24 00:13:53 2022] POST /identity/v3/groups => generated 229 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:13:53.902373 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afc7c9-52a5-4b95-9c3c-f09ddb1bf1ba None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:54.036566 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afc7c9-52a5-4b95-9c3c-f09ddb1bf1ba None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:54.077672 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb80cb-7403-4677-bc66-b63a38d04001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:54.079254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb80cb-7403-4677-bc66-b63a38d04001 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:54.079782 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb80cb-7403-4677-bc66-b63a38d04001 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:54.080277 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb80cb-7403-4677-bc66-b63a38d04001 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:54.092675 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb80cb-7403-4677-bc66-b63a38d04001 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:54.100662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-61eb80cb-7403-4677-bc66-b63a38d04001 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:13:54.100662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:54.100662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:54.100662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:54.100662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:54.100662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:54.100662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:54.100662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:54.100662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:54.100662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:54.100662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:54.100662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:54.100662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:54.100662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:54.100662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:54.100662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:54.102072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:54.102072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:54.102072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:54.102072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:54.102072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:54.102072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:54.102072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:54.102072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:54.102072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:54.102072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:54.102072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:54.102072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:54.102072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:54.102072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:54.102072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:54.102072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:54.102893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:54.102893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:54.102893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:54.102893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:54.102893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:54.102893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:54.102893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:54.102893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:54.102893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:54.102893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:54.102893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:13:54.102893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:13:54.102893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 154/301] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:54.107006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b778b-c9e9-4839-97a7-7fc23814dd62 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:54.154781 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44f10f-8175-454a-91ca-ed54950c7002 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:54.155122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44f10f-8175-454a-91ca-ed54950c7002 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:54.155366 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44f10f-8175-454a-91ca-ed54950c7002 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:54.157607 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 155/302] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:13:54.162759 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca56c9-af2f-4931-9257-16777f5a8474 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:54.163144 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca56c9-af2f-4931-9257-16777f5a8474 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:54.163359 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca56c9-af2f-4931-9257-16777f5a8474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:54.182077 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-e6ca56c9-af2f-4931-9257-16777f5a8474 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:54.183433 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-e6ca56c9-af2f-4931-9257-16777f5a8474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:54.213805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:54.230477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b778b-c9e9-4839-97a7-7fc23814dd62 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:54.244485 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:54.269944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11644d8e-61a1-4acf-a322-26a23fd2b9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:54.270599 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11644d8e-61a1-4acf-a322-26a23fd2b9ad None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:54.270890 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11644d8e-61a1-4acf-a322-26a23fd2b9ad None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:54.271209 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11644d8e-61a1-4acf-a322-26a23fd2b9ad None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:54.271885 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11644d8e-61a1-4acf-a322-26a23fd2b9ad None admin] RBAC: Adding query filter params (name=reader) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:54.272193 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11644d8e-61a1-4acf-a322-26a23fd2b9ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:54.273587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11644d8e-61a1-4acf-a322-26a23fd2b9ad None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:54.275253 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 156/303] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:54.287418 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 148/304] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:54.294322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca56c9-af2f-4931-9257-16777f5a8474 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:54.364209 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db27ae-4712-4a10-923f-da13738a0d4a None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:54.364507 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db27ae-4712-4a10-923f-da13738a0d4a None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:54.364766 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db27ae-4712-4a10-923f-da13738a0d4a None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:54.366402 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 149/305] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:13:54.371544 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53384c-d2dd-454a-a470-c68ba3143747 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:54.371822 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53384c-d2dd-454a-a470-c68ba3143747 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:54.372806 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53384c-d2dd-454a-a470-c68ba3143747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:54.391773 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-2b53384c-d2dd-454a-a470-c68ba3143747 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:54.392945 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-2b53384c-d2dd-454a-a470-c68ba3143747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:54.404279 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca56c9-af2f-4931-9257-16777f5a8474 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:54.455214 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000a87b-b69e-4dc6-9288-3a86bab00107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:54.456153 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000a87b-b69e-4dc6-9288-3a86bab00107 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:54.456623 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000a87b-b69e-4dc6-9288-3a86bab00107 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:54.457024 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000a87b-b69e-4dc6-9288-3a86bab00107 None admin] PATH_INFO: `/v3/users/4571c3e694a6433ea5ff1da07ed3a07f` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:54.472160 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000a87b-b69e-4dc6-9288-3a86bab00107 None admin] RBAC: Authorizing `identity:get_user(user_id=4571c3e694a6433ea5ff1da07ed3a07f)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:54.473771 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000a87b-b69e-4dc6-9288-3a86bab00107 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:54.480495 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 157/306] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:54 2022] GET /identity/v3/users/4571c3e694a6433ea5ff1da07ed3a07f => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:54.483054 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000a87b-b69e-4dc6-9288-3a86bab00107 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:54.487070 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 150/307] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:13:54.507381 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:54.602242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000a87b-b69e-4dc6-9288-3a86bab00107 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:54.616253 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53384c-d2dd-454a-a470-c68ba3143747 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:54.638814 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408a52e-1f04-4f7c-9496-9c60a4e228c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:54.639881 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408a52e-1f04-4f7c-9496-9c60a4e228c6 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:54.640168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408a52e-1f04-4f7c-9496-9c60a4e228c6 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:54.640519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408a52e-1f04-4f7c-9496-9c60a4e228c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:54.641544 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408a52e-1f04-4f7c-9496-9c60a4e228c6 None admin] RBAC: Adding query filter params (role.id=4eba322b310a4c6a8962dfb897571cf3, user.id=4571c3e694a6433ea5ff1da07ed3a07f, scope.system=all) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:54.641862 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408a52e-1f04-4f7c-9496-9c60a4e228c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:54.644115 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408a52e-1f04-4f7c-9496-9c60a4e228c6 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:54.650603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 158/308] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Aug 24 00:13:54 2022] GET /identity/v3/role_assignments?user.id=4571c3e694a6433ea5ff1da07ed3a07f&scope.system=all&role.id=4eba322b310a4c6a8962dfb897571cf3 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:54.732012 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53384c-d2dd-454a-a470-c68ba3143747 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:54.735206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:54.770874 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f30bb-b765-49f3-b1ce-3962655aec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:54.771559 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f30bb-b765-49f3-b1ce-3962655aec12 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:54.771839 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f30bb-b765-49f3-b1ce-3962655aec12 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:54.772114 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f30bb-b765-49f3-b1ce-3962655aec12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:54.784567 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f30bb-b765-49f3-b1ce-3962655aec12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:54.789761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-079f30bb-b765-49f3-b1ce-3962655aec12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:54.789761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:54.789761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:54.789761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:54.789761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:54.789761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:54.789761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:54.789761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:54.789761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:54.789761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:54.789761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:54.789761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:54.789761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:54.789761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:54.789761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:54.789761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:54.790816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:54.790816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:54.790816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:54.790816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:54.790816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:54.790816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:54.790816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:54.790816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:54.790816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:54.790816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:54.790816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:54.790816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:54.790816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:54.790816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:54.790816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:54.790816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:54.791657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:54.791657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:54.791657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:54.791657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:54.791657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:54.791657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:54.791657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:54.791657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:54.791657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:54.791657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:54.791657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:54.791657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:54.795400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 151/309] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:13:54.797868 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408a52e-1f04-4f7c-9496-9c60a4e228c6 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:54.844236 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f30bb-b765-49f3-b1ce-3962655aec12 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:54.884926 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:54.912956 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408a52e-1f04-4f7c-9496-9c60a4e228c6 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:54.950398 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f034b-5ad6-4659-8a8c-3575fb35c220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:54.951206 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f034b-5ad6-4659-8a8c-3575fb35c220 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:54.951589 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f034b-5ad6-4659-8a8c-3575fb35c220 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:54.951964 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f034b-5ad6-4659-8a8c-3575fb35c220 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:54.953270 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f034b-5ad6-4659-8a8c-3575fb35c220 None admin] RBAC: Adding query filter params (name=member) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:54.953690 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f034b-5ad6-4659-8a8c-3575fb35c220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:54.955220 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f034b-5ad6-4659-8a8c-3575fb35c220 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:54.964642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 159/310] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:54.972639 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f034b-5ad6-4659-8a8c-3575fb35c220 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:54.998521 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f30bb-b765-49f3-b1ce-3962655aec12 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:55.055644 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ddd57-6637-47f6-8101-d135ed94c91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:55.056620 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ddd57-6637-47f6-8101-d135ed94c91e None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:55.057301 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ddd57-6637-47f6-8101-d135ed94c91e None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:55.057729 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ddd57-6637-47f6-8101-d135ed94c91e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:55.072254 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ddd57-6637-47f6-8101-d135ed94c91e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:55.080125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-588ddd57-6637-47f6-8101-d135ed94c91e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:13:55.080125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:55.080125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:55.080125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:55.080125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:55.080125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:55.080125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:55.080125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:55.080125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:55.080125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:55.080125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:55.080125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:55.080125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:55.080125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:55.080125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:55.080125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:55.081259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:55.081259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:55.081259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:55.081259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:55.081259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:55.081259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:55.081259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:55.081259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:55.081259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:55.081259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:55.081259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:55.081259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:55.081259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:55.081259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:55.081259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:55.081259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:55.082269 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:55.082269 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:55.082269 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:55.082269 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:55.082269 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:55.082269 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:55.082269 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:55.082269 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:55.082269 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:55.082269 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:55.082269 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:13:55.082269 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:55.084899 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 152/311] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:13:55.091380 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ddd57-6637-47f6-8101-d135ed94c91e None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:55.111142 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f034b-5ad6-4659-8a8c-3575fb35c220 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:55.119563 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:55.162758 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e35923-ce80-4ede-87bc-5cf1414ac017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:55.163945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e35923-ce80-4ede-87bc-5cf1414ac017 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:55.164775 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e35923-ce80-4ede-87bc-5cf1414ac017 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:55.165474 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e35923-ce80-4ede-87bc-5cf1414ac017 None admin] PATH_INFO: `/v3/users/a0cd062e42cd4af69e84c7041106e706` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:55.166846 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e35923-ce80-4ede-87bc-5cf1414ac017 None admin] RBAC: Authorizing `identity:get_user(user_id=a0cd062e42cd4af69e84c7041106e706)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:55.168771 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e35923-ce80-4ede-87bc-5cf1414ac017 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:55.171768 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 160/312] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:54 2022] GET /identity/v3/users/a0cd062e42cd4af69e84c7041106e706 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:55.178699 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e35923-ce80-4ede-87bc-5cf1414ac017 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:55.195381 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:55.213517 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ddd57-6637-47f6-8101-d135ed94c91e None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:55.250791 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de170604-ddef-4048-a48a-e99bbf2be3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:55.251541 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de170604-ddef-4048-a48a-e99bbf2be3b1 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:55.251883 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de170604-ddef-4048-a48a-e99bbf2be3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:55.252223 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de170604-ddef-4048-a48a-e99bbf2be3b1 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:55.253009 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de170604-ddef-4048-a48a-e99bbf2be3b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:55.253390 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de170604-ddef-4048-a48a-e99bbf2be3b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:55.254983 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de170604-ddef-4048-a48a-e99bbf2be3b1 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:55.264905 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 153/313] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:55.271482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de170604-ddef-4048-a48a-e99bbf2be3b1 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:55.313146 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e35923-ce80-4ede-87bc-5cf1414ac017 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:55.360514 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebf6c3-bb35-480c-80e8-ea6b78ee18df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:55.361989 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebf6c3-bb35-480c-80e8-ea6b78ee18df None admin] REQUEST_METHOD: `PUT` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:55.362554 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebf6c3-bb35-480c-80e8-ea6b78ee18df None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:55.363037 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebf6c3-bb35-480c-80e8-ea6b78ee18df None admin] PATH_INFO: `/v3/system/users/a0cd062e42cd4af69e84c7041106e706/roles/3fe3a1eb546b456aa3c8bce846a8d37f` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:55.364947 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:55.366112 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebf6c3-bb35-480c-80e8-ea6b78ee18df None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a0cd062e42cd4af69e84c7041106e706, role_id=3fe3a1eb546b456aa3c8bce846a8d37f)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:55.367723 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebf6c3-bb35-480c-80e8-ea6b78ee18df None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:55.381182 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 161/314] 10.222.0.42 () {58 vars in 1334 bytes} [Wed Aug 24 00:13:55 2022] PUT /identity/v3/system/users/a0cd062e42cd4af69e84c7041106e706/roles/3fe3a1eb546b456aa3c8bce846a8d37f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 00:13:55.394038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de170604-ddef-4048-a48a-e99bbf2be3b1 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:55.436271 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d2c68-33e8-4ec1-9dfb-e7b8f902ea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:55.437885 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d2c68-33e8-4ec1-9dfb-e7b8f902ea3b None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:55.438403 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d2c68-33e8-4ec1-9dfb-e7b8f902ea3b None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:55.438898 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d2c68-33e8-4ec1-9dfb-e7b8f902ea3b None admin] PATH_INFO: `/v3/users/843e2c62200c41f4a30288ac69844640` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:55.440769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d2c68-33e8-4ec1-9dfb-e7b8f902ea3b None admin] RBAC: Authorizing `identity:get_user(user_id=843e2c62200c41f4a30288ac69844640)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:55.442898 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d2c68-33e8-4ec1-9dfb-e7b8f902ea3b None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:55.445019 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 154/315] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:55 2022] GET /identity/v3/users/843e2c62200c41f4a30288ac69844640 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:13:55.451064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebf6c3-bb35-480c-80e8-ea6b78ee18df None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:55.531972 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:55.570464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebf6c3-bb35-480c-80e8-ea6b78ee18df None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:55.607959 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f9648-17a4-4c73-be64-4430da855517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:55.608622 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f9648-17a4-4c73-be64-4430da855517 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:55.608908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f9648-17a4-4c73-be64-4430da855517 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:55.609783 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f9648-17a4-4c73-be64-4430da855517 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:55.697705 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f9648-17a4-4c73-be64-4430da855517 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:55.699185 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f9648-17a4-4c73-be64-4430da855517 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:55.772674 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:55.815364 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 162/316] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:13:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:13:55.817284 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d2c68-33e8-4ec1-9dfb-e7b8f902ea3b None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:55.929112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d2c68-33e8-4ec1-9dfb-e7b8f902ea3b None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:55.966403 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c1265-ee73-4402-a14e-11e1f05ab0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:55.967485 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c1265-ee73-4402-a14e-11e1f05ab0c2 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:55.968000 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c1265-ee73-4402-a14e-11e1f05ab0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:55.969022 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c1265-ee73-4402-a14e-11e1f05ab0c2 None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:55.970359 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c1265-ee73-4402-a14e-11e1f05ab0c2 None admin] RBAC: Authorizing `identity:get_project(project_id=60965deec4684d2f95fd5e6ebac6f77c)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:55.972044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c1265-ee73-4402-a14e-11e1f05ab0c2 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:55.974311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 155/317] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:13:55 2022] GET /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:55.980039 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f9648-17a4-4c73-be64-4430da855517 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:56.087383 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f9648-17a4-4c73-be64-4430da855517 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:56.128018 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1c7b0-dad4-4bac-9e4c-c73a5e99dd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:56.129467 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1c7b0-dad4-4bac-9e4c-c73a5e99dd65 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:56.129951 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1c7b0-dad4-4bac-9e4c-c73a5e99dd65 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:56.130476 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1c7b0-dad4-4bac-9e4c-c73a5e99dd65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:56.131455 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1c7b0-dad4-4bac-9e4c-c73a5e99dd65 None admin] RBAC: Adding query filter params (role.id=4eba322b310a4c6a8962dfb897571cf3, scope.project.id=60965deec4684d2f95fd5e6ebac6f77c, user.id=843e2c62200c41f4a30288ac69844640) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:56.131975 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1c7b0-dad4-4bac-9e4c-c73a5e99dd65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:56.133666 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1c7b0-dad4-4bac-9e4c-c73a5e99dd65 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:56.140869 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 163/318] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:13:55 2022] GET /identity/v3/role_assignments?user.id=843e2c62200c41f4a30288ac69844640&scope.project.id=60965deec4684d2f95fd5e6ebac6f77c&role.id=4eba322b310a4c6a8962dfb897571cf3 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:56.270202 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51bf06-83c3-4302-a9bd-b21e59179900 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:56.271340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51bf06-83c3-4302-a9bd-b21e59179900 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:56.271952 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51bf06-83c3-4302-a9bd-b21e59179900 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:56.274227 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 156/319] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:13:56.281601 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7405dd6-cadb-4746-b04b-53f637ebdfe7 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:56.282249 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7405dd6-cadb-4746-b04b-53f637ebdfe7 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:56.282726 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7405dd6-cadb-4746-b04b-53f637ebdfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:56.303928 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-a7405dd6-cadb-4746-b04b-53f637ebdfe7 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:56.305495 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-a7405dd6-cadb-4746-b04b-53f637ebdfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:56.335941 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:56.381739 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 164/320] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:13:56.710549 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51bf06-83c3-4302-a9bd-b21e59179900 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:56.739842 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:56.824520 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51bf06-83c3-4302-a9bd-b21e59179900 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:56.859358 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72083c-f41a-4a12-aaed-23cd32871dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:56.860031 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72083c-f41a-4a12-aaed-23cd32871dd6 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:56.860347 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72083c-f41a-4a12-aaed-23cd32871dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:56.860653 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72083c-f41a-4a12-aaed-23cd32871dd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:56.861783 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72083c-f41a-4a12-aaed-23cd32871dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:56.863520 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72083c-f41a-4a12-aaed-23cd32871dd6 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:56.865345 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 157/321] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:13:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:56.870902 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7405dd6-cadb-4746-b04b-53f637ebdfe7 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:56.889688 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4134985-bd30-4f13-b5a7-01c4d10ace1c None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:56.890015 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4134985-bd30-4f13-b5a7-01c4d10ace1c None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:56.891077 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4134985-bd30-4f13-b5a7-01c4d10ace1c None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:56.892386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 158/322] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:13:56.897818 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f145ea1-d3f7-4e70-9833-3ceabf8096ae None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:56.898137 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f145ea1-d3f7-4e70-9833-3ceabf8096ae None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:56.898450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f145ea1-d3f7-4e70-9833-3ceabf8096ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:56.917500 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-7f145ea1-d3f7-4e70-9833-3ceabf8096ae None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:56.918705 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-7f145ea1-d3f7-4e70-9833-3ceabf8096ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:56.981615 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7405dd6-cadb-4746-b04b-53f637ebdfe7 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:56.988880 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 159/323] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:13:57.018679 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c35eee-6acb-42ca-a617-304e9a515b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:57.019331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c35eee-6acb-42ca-a617-304e9a515b9d None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:57.019611 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c35eee-6acb-42ca-a617-304e9a515b9d None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:57.019880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c35eee-6acb-42ca-a617-304e9a515b9d None admin] PATH_INFO: `/v3/groups` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:57.020509 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c35eee-6acb-42ca-a617-304e9a515b9d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:57.021950 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c35eee-6acb-42ca-a617-304e9a515b9d None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:57.043164 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 165/324] 10.222.0.42 () {60 vars in 1134 bytes} [Wed Aug 24 00:13:56 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:13:57.326951 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f145ea1-d3f7-4e70-9833-3ceabf8096ae None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:57.349258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:57.433242 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f145ea1-d3f7-4e70-9833-3ceabf8096ae None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:57.469972 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc75a7-5dc2-4284-9578-f62e1223669c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:57.470615 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc75a7-5dc2-4284-9578-f62e1223669c None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:57.470894 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc75a7-5dc2-4284-9578-f62e1223669c None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:57.471195 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc75a7-5dc2-4284-9578-f62e1223669c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:57.482162 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc75a7-5dc2-4284-9578-f62e1223669c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:57.487832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-38cc75a7-5dc2-4284-9578-f62e1223669c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:13:57.487832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:57.487832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:57.487832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:57.487832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:57.487832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:57.487832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:57.487832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:57.487832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:57.487832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:57.487832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:57.487832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:57.487832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:57.487832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:57.487832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:57.487832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:57.488734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:57.488734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:57.488734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:57.488734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:57.488734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:57.488734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:57.488734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:57.488734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:57.488734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:57.488734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:57.488734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:57.488734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:57.488734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:57.488734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:57.488734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:57.488734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:57.489684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:57.489684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:57.489684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:57.489684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:57.489684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:57.489684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:57.489684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:57.489684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:57.489684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:57.489684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:57.489684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:13:57.489684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:13:57.489684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 160/325] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:57.495194 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c35eee-6acb-42ca-a617-304e9a515b9d None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:57.527269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:57.628553 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c35eee-6acb-42ca-a617-304e9a515b9d None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:57.666406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b213d-8489-4b31-a327-56c9e7274c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:57.667394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b213d-8489-4b31-a327-56c9e7274c1e None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:57.667934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b213d-8489-4b31-a327-56c9e7274c1e None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:57.668389 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b213d-8489-4b31-a327-56c9e7274c1e None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:57.669240 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b213d-8489-4b31-a327-56c9e7274c1e None admin] RBAC: Adding query filter params (name=reader) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:57.669751 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b213d-8489-4b31-a327-56c9e7274c1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:57.671347 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b213d-8489-4b31-a327-56c9e7274c1e None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:57.681456 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 166/326] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:57.687490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc75a7-5dc2-4284-9578-f62e1223669c None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:57.766703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db582403-a37d-4760-a1ff-5c9955b225b5 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:57.766988 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db582403-a37d-4760-a1ff-5c9955b225b5 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:57.767308 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db582403-a37d-4760-a1ff-5c9955b225b5 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:57.768903 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 167/327] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:13:57.774299 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1c4cb-5695-4552-9cdb-c110030c8911 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:57.774580 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1c4cb-5695-4552-9cdb-c110030c8911 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:57.774858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1c4cb-5695-4552-9cdb-c110030c8911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:57.783363 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:57.797517 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-b4f1c4cb-5695-4552-9cdb-c110030c8911 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:13:57.798814 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-b4f1c4cb-5695-4552-9cdb-c110030c8911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:13:57.821331 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc75a7-5dc2-4284-9578-f62e1223669c None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:57.860571 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b2706-404f-46b4-8532-cdfa6f22191c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:57.861206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b2706-404f-46b4-8532-cdfa6f22191c None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:57.861488 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b2706-404f-46b4-8532-cdfa6f22191c None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:57.861756 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b2706-404f-46b4-8532-cdfa6f22191c None admin] PATH_INFO: `/v3/users/4571c3e694a6433ea5ff1da07ed3a07f` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:57.862909 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b2706-404f-46b4-8532-cdfa6f22191c None admin] RBAC: Authorizing `identity:get_user(user_id=4571c3e694a6433ea5ff1da07ed3a07f)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:57.864416 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b2706-404f-46b4-8532-cdfa6f22191c None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:57.866378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 161/328] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:57 2022] GET /identity/v3/users/4571c3e694a6433ea5ff1da07ed3a07f => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:57.873106 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b2706-404f-46b4-8532-cdfa6f22191c None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:57.884807 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 168/329] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:13:57.994574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b2706-404f-46b4-8532-cdfa6f22191c None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:58.031737 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3bcfa-5e9d-4136-9f8b-e52893d4d083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:58.032389 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3bcfa-5e9d-4136-9f8b-e52893d4d083 None admin] REQUEST_METHOD: `PUT` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:58.032666 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3bcfa-5e9d-4136-9f8b-e52893d4d083 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:58.032942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3bcfa-5e9d-4136-9f8b-e52893d4d083 None admin] PATH_INFO: `/v3/system/users/4571c3e694a6433ea5ff1da07ed3a07f/roles/4eba322b310a4c6a8962dfb897571cf3` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:58.034362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3bcfa-5e9d-4136-9f8b-e52893d4d083 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4571c3e694a6433ea5ff1da07ed3a07f, role_id=4eba322b310a4c6a8962dfb897571cf3)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:58.037633 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3bcfa-5e9d-4136-9f8b-e52893d4d083 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:58.048838 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 162/330] 10.222.0.42 () {58 vars in 1334 bytes} [Wed Aug 24 00:13:57 2022] PUT /identity/v3/system/users/4571c3e694a6433ea5ff1da07ed3a07f/roles/4eba322b310a4c6a8962dfb897571cf3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:13:58.275698 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1c4cb-5695-4552-9cdb-c110030c8911 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:58.296245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:58.409388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1c4cb-5695-4552-9cdb-c110030c8911 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:58.473719 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854cbb8-f019-4cec-a847-cbd4bcaf1f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:58.474856 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854cbb8-f019-4cec-a847-cbd4bcaf1f3b None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:58.475377 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854cbb8-f019-4cec-a847-cbd4bcaf1f3b None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:58.475917 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854cbb8-f019-4cec-a847-cbd4bcaf1f3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:58.490988 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854cbb8-f019-4cec-a847-cbd4bcaf1f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:13:58.496256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-d854cbb8-f019-4cec-a847-cbd4bcaf1f3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:58.496256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:13:58.496256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:13:58.496256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:13:58.496256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:13:58.496256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:13:58.496256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:13:58.496256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:13:58.496256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:13:58.496256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:13:58.496256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:13:58.496256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:13:58.496256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:13:58.496256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:13:58.496256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:13:58.496256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:13:58.497597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:13:58.497597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:13:58.497597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:13:58.497597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:13:58.497597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:13:58.497597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:13:58.497597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:13:58.497597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:13:58.497597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:13:58.497597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:13:58.497597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:13:58.497597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:13:58.497597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:13:58.497597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:13:58.497597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:13:58.497597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:13:58.498398 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:13:58.498398 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:13:58.498398 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:13:58.498398 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:13:58.498398 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:13:58.498398 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:13:58.498398 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:13:58.498398 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:13:58.498398 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:13:58.498398 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:13:58.498398 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:13:58.498398 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:13:58.501362 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 169/331] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:13:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:13:58.510007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3bcfa-5e9d-4136-9f8b-e52893d4d083 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:58.539545 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:58.634118 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3bcfa-5e9d-4136-9f8b-e52893d4d083 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:58.681881 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b04eb-7061-4bd2-bd3b-f3aa174d28da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:58.682917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b04eb-7061-4bd2-bd3b-f3aa174d28da None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:58.683418 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b04eb-7061-4bd2-bd3b-f3aa174d28da None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:58.683888 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b04eb-7061-4bd2-bd3b-f3aa174d28da None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:58.684774 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b04eb-7061-4bd2-bd3b-f3aa174d28da None admin] RBAC: Adding query filter params (name=member) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:58.685288 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b04eb-7061-4bd2-bd3b-f3aa174d28da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:58.686878 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b04eb-7061-4bd2-bd3b-f3aa174d28da None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:58.701063 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 163/332] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:13:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:58.709233 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854cbb8-f019-4cec-a847-cbd4bcaf1f3b None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:58.821085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:58.845781 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854cbb8-f019-4cec-a847-cbd4bcaf1f3b None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:58.888559 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a4b5e-4623-4c7e-ae08-4a1349cf51dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:58.889190 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a4b5e-4623-4c7e-ae08-4a1349cf51dc None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:58.889469 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a4b5e-4623-4c7e-ae08-4a1349cf51dc None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:58.889740 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a4b5e-4623-4c7e-ae08-4a1349cf51dc None admin] PATH_INFO: `/v3/users/a0cd062e42cd4af69e84c7041106e706` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:58.895677 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a4b5e-4623-4c7e-ae08-4a1349cf51dc None admin] RBAC: Authorizing `identity:get_user(user_id=a0cd062e42cd4af69e84c7041106e706)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:58.897153 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a4b5e-4623-4c7e-ae08-4a1349cf51dc None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:58.899088 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 170/333] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:13:58 2022] GET /identity/v3/users/a0cd062e42cd4af69e84c7041106e706 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:13:58.907828 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b04eb-7061-4bd2-bd3b-f3aa174d28da None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:13:59.025164 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:13:59.053201 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b04eb-7061-4bd2-bd3b-f3aa174d28da None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:13:59.101009 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d0c79-4b61-4ea2-8069-6b51f4b468d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:13:59.101547 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d0c79-4b61-4ea2-8069-6b51f4b468d1 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:13:59.101827 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d0c79-4b61-4ea2-8069-6b51f4b468d1 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:13:59.102105 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d0c79-4b61-4ea2-8069-6b51f4b468d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:13:59.102830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d0c79-4b61-4ea2-8069-6b51f4b468d1 None admin] RBAC: Adding query filter params (role.id=3fe3a1eb546b456aa3c8bce846a8d37f, user.id=a0cd062e42cd4af69e84c7041106e706, scope.system=all) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:13:59.103169 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d0c79-4b61-4ea2-8069-6b51f4b468d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:13:59.104611 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d0c79-4b61-4ea2-8069-6b51f4b468d1 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:13:59.119674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 164/334] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Aug 24 00:13:58 2022] GET /identity/v3/role_assignments?user.id=a0cd062e42cd4af69e84c7041106e706&scope.system=all&role.id=3fe3a1eb546b456aa3c8bce846a8d37f => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:00.219556 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe5b75-66dd-4a6c-845e-afb7426f1f36 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:00.220575 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe5b75-66dd-4a6c-845e-afb7426f1f36 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:00.221060 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe5b75-66dd-4a6c-845e-afb7426f1f36 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:00.222841 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 171/335] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:00.228775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9b3fc-c706-4594-b608-0f9b419040ee None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:00.229599 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9b3fc-c706-4594-b608-0f9b419040ee None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:00.230117 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9b3fc-c706-4594-b608-0f9b419040ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:00.249924 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-eaa9b3fc-c706-4594-b608-0f9b419040ee None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:00.251484 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-eaa9b3fc-c706-4594-b608-0f9b419040ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:00.330073 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 165/336] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:14:00.700665 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe5b75-66dd-4a6c-845e-afb7426f1f36 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:00.829809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe5b75-66dd-4a6c-845e-afb7426f1f36 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:00.873780 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bacf8-914a-45e0-9fe3-40f12c768838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:00.875337 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bacf8-914a-45e0-9fe3-40f12c768838 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:00.875839 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bacf8-914a-45e0-9fe3-40f12c768838 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:00.876326 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bacf8-914a-45e0-9fe3-40f12c768838 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:00.892886 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bacf8-914a-45e0-9fe3-40f12c768838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:00.898311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-642bacf8-914a-45e0-9fe3-40f12c768838 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:00.898311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:00.898311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:00.898311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:00.898311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:00.898311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:00.898311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:00.898311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:00.898311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:00.898311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:00.898311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:00.898311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:00.898311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:00.898311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:00.898311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:00.898311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:00.899305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:00.899305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:00.899305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:00.899305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:00.899305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:00.899305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:00.899305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:00.899305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:00.899305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:00.899305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:00.899305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:00.899305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:00.899305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:00.899305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:00.899305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:00.899305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:00.900099 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:00.900099 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:00.900099 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:00.900099 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:00.900099 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:00.900099 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:00.900099 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:00.900099 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:00.900099 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:00.900099 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:00.900099 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:00.900099 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:00.902899 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 172/337] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:00.909321 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9b3fc-c706-4594-b608-0f9b419040ee None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:00.983421 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:01.040909 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9b3fc-c706-4594-b608-0f9b419040ee None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:01.081478 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25ea8a-1238-467e-8a4c-79c44317eb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:01.082023 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25ea8a-1238-467e-8a4c-79c44317eb86 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:01.082306 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25ea8a-1238-467e-8a4c-79c44317eb86 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:01.082580 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25ea8a-1238-467e-8a4c-79c44317eb86 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:01.083286 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25ea8a-1238-467e-8a4c-79c44317eb86 None admin] RBAC: Adding query filter params (name=member) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:01.083594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25ea8a-1238-467e-8a4c-79c44317eb86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:01.085469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25ea8a-1238-467e-8a4c-79c44317eb86 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:01.096417 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 166/338] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:14:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:01.102204 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bacf8-914a-45e0-9fe3-40f12c768838 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:01.106740 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:01.227537 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff957-d43e-4890-bdf5-ad734d23e091 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:01.228192 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff957-d43e-4890-bdf5-ad734d23e091 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:01.228697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff957-d43e-4890-bdf5-ad734d23e091 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:01.230318 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 167/339] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:01.236692 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c3d04-b081-4f76-9ef2-9e523b751208 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:01.237265 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c3d04-b081-4f76-9ef2-9e523b751208 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:01.237746 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c3d04-b081-4f76-9ef2-9e523b751208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:01.253277 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bacf8-914a-45e0-9fe3-40f12c768838 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:01.260106 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-523c3d04-b081-4f76-9ef2-9e523b751208 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:01.261548 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-523c3d04-b081-4f76-9ef2-9e523b751208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:01.309030 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa0cf1-123a-4224-9381-54f3e45fd8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:01.309642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa0cf1-123a-4224-9381-54f3e45fd8ee None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:01.309919 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa0cf1-123a-4224-9381-54f3e45fd8ee None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:01.310211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa0cf1-123a-4224-9381-54f3e45fd8ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:01.336676 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 168/340] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:14:01.427677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beffdd3-5071-402e-8965-0441618e2b81 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:01.428315 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beffdd3-5071-402e-8965-0441618e2b81 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:01.428792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beffdd3-5071-402e-8965-0441618e2b81 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:01.430460 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 169/341] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:14:01.434401 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa0cf1-123a-4224-9381-54f3e45fd8ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:01.436082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa0cf1-123a-4224-9381-54f3e45fd8ee None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:01.436483 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6eb4b-4eb5-441c-820c-deea72e590c6 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:01.437545 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6eb4b-4eb5-441c-820c-deea72e590c6 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:01.438040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6eb4b-4eb5-441c-820c-deea72e590c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:01.451349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:01.461474 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-c3a6eb4b-4eb5-441c-820c-deea72e590c6 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:01.462836 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-c3a6eb4b-4eb5-441c-820c-deea72e590c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:01.539695 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:01.564297 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 170/342] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:01.609332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 173/343] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:01.615272 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6eb4b-4eb5-441c-820c-deea72e590c6 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:01.758720 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6eb4b-4eb5-441c-820c-deea72e590c6 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:01.798954 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33d879-0cef-49f7-9d23-6f9b990361c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:01.800037 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33d879-0cef-49f7-9d23-6f9b990361c5 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:01.800519 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33d879-0cef-49f7-9d23-6f9b990361c5 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:01.800993 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33d879-0cef-49f7-9d23-6f9b990361c5 None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:01.802486 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33d879-0cef-49f7-9d23-6f9b990361c5 None admin] RBAC: Authorizing `identity:get_project(project_id=10ae72b6264047109854b2e9468e9ba3)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:01.804193 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33d879-0cef-49f7-9d23-6f9b990361c5 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:01.806059 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 171/344] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:01 2022] GET /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:01.811738 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa0cf1-123a-4224-9381-54f3e45fd8ee None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:01.892808 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33d879-0cef-49f7-9d23-6f9b990361c5 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:01.978945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa0cf1-123a-4224-9381-54f3e45fd8ee None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:01.999367 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:01.999550 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:02.053696 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4adf6-edf9-43bb-be85-f3c599aca953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:02.054345 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4adf6-edf9-43bb-be85-f3c599aca953 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:02.054628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4adf6-edf9-43bb-be85-f3c599aca953 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:02.054903 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4adf6-edf9-43bb-be85-f3c599aca953 None admin] PATH_INFO: `/v3/groups/f47970dca072475d935952796585962f` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:02.070735 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4adf6-edf9-43bb-be85-f3c599aca953 None admin] RBAC: Authorizing `identity:get_group(group_id=f47970dca072475d935952796585962f)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:02.072285 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4adf6-edf9-43bb-be85-f3c599aca953 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:02.082267 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 174/345] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 00:14:01 2022] GET /identity/v3/groups/f47970dca072475d935952796585962f => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:02.097178 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4adf6-edf9-43bb-be85-f3c599aca953 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:02.117896 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33d879-0cef-49f7-9d23-6f9b990361c5 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:02.176506 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712320b-941e-4269-8c86-93fb38f5f516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:02.177078 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712320b-941e-4269-8c86-93fb38f5f516 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:02.177359 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712320b-941e-4269-8c86-93fb38f5f516 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:02.177638 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712320b-941e-4269-8c86-93fb38f5f516 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:02.190963 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712320b-941e-4269-8c86-93fb38f5f516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:02.196013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-3712320b-941e-4269-8c86-93fb38f5f516 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:14:02.196013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:02.196013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:02.196013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:02.196013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:02.196013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:02.196013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:02.196013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:02.196013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:02.196013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:02.196013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:02.196013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:02.196013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:02.196013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:02.196013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:02.196013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:02.196971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:02.196971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:02.196971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:02.196971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:02.196971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:02.196971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:02.196971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:02.196971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:02.196971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:02.196971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:02.196971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:02.196971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:02.196971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:02.196971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:02.196971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:02.196971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:02.197830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:02.197830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:02.197830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:02.197830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:02.197830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:02.197830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:02.197830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:02.197830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:02.197830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:02.197830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:02.197830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:14:02.197830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:02.197830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 172/346] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:14:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:02.198530 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712320b-941e-4269-8c86-93fb38f5f516 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:02.256988 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4adf6-edf9-43bb-be85-f3c599aca953 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:02.297660 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735e001-ca48-4de3-aa3e-5ee0828719e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:02.298680 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e001-ca48-4de3-aa3e-5ee0828719e0 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:02.299219 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e001-ca48-4de3-aa3e-5ee0828719e0 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:02.299646 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e001-ca48-4de3-aa3e-5ee0828719e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:02.300523 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735e001-ca48-4de3-aa3e-5ee0828719e0 None admin] RBAC: Adding query filter params (group.id=f47970dca072475d935952796585962f, role.id=3fe3a1eb546b456aa3c8bce846a8d37f, scope.project.id=10ae72b6264047109854b2e9468e9ba3) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:02.300985 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735e001-ca48-4de3-aa3e-5ee0828719e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:02.303196 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735e001-ca48-4de3-aa3e-5ee0828719e0 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:02.309479 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 175/347] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 00:14:02 2022] GET /identity/v3/role_assignments?group.id=f47970dca072475d935952796585962f&scope.project.id=10ae72b6264047109854b2e9468e9ba3&role.id=3fe3a1eb546b456aa3c8bce846a8d37f => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:02.310468 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735e001-ca48-4de3-aa3e-5ee0828719e0 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:02.336552 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712320b-941e-4269-8c86-93fb38f5f516 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:02.356390 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:02.370712 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:02.384195 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf04d0-3196-471d-ae67-4c2b7f16dfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:02.385128 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf04d0-3196-471d-ae67-4c2b7f16dfae None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:02.385563 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf04d0-3196-471d-ae67-4c2b7f16dfae None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:02.385991 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf04d0-3196-471d-ae67-4c2b7f16dfae None admin] PATH_INFO: `/v3/roles/member` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:02.406402 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf04d0-3196-471d-ae67-4c2b7f16dfae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:02.411482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-4ecf04d0-3196-471d-ae67-4c2b7f16dfae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:02.411482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:02.411482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:02.411482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:02.411482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:02.411482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:02.411482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:02.411482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:02.411482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:02.411482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:02.411482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:02.411482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:02.411482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:02.411482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:02.411482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:02.411482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:02.412937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:02.412937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:02.412937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:02.412937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:02.412937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:02.412937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:02.412937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:02.412937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:02.412937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:02.412937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:02.412937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:02.412937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:02.412937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:02.412937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:02.412937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:02.412937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:02.414668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:02.414668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:02.414668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:02.414668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:02.414668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:02.414668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:02.414668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:02.414668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:02.414668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:02.414668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:02.414668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:02.414668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:02.414668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 173/348] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:02.414668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c3ea4-9bdc-41f9-9f52-461c99cd61ea None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:02.415770 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c3ea4-9bdc-41f9-9f52-461c99cd61ea None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:02.415770 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c3ea4-9bdc-41f9-9f52-461c99cd61ea None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:02.419576 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 174/349] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:02.420803 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d41245-d59b-4d26-9571-26a46a24c47d None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:02.421097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d41245-d59b-4d26-9571-26a46a24c47d None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:02.421499 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d41245-d59b-4d26-9571-26a46a24c47d None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:02.426819 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 175/350] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:02.426819 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d41245-d59b-4d26-9571-26a46a24c47d None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:02.504493 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735e001-ca48-4de3-aa3e-5ee0828719e0 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:02.558381 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ec7a9-6eab-4ffb-998c-1b894033cdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:02.559421 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ec7a9-6eab-4ffb-998c-1b894033cdb6 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:02.559915 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ec7a9-6eab-4ffb-998c-1b894033cdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:02.560190 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ec7a9-6eab-4ffb-998c-1b894033cdb6 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:02.560890 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ec7a9-6eab-4ffb-998c-1b894033cdb6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:02.561203 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ec7a9-6eab-4ffb-998c-1b894033cdb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:02.562719 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ec7a9-6eab-4ffb-998c-1b894033cdb6 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:02.574045 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 176/351] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:02.575555 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781b7d2-6cf3-4948-bfdc-18d4705cfa10 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:02.575850 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781b7d2-6cf3-4948-bfdc-18d4705cfa10 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:02.576199 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781b7d2-6cf3-4948-bfdc-18d4705cfa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:02.583588 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d41245-d59b-4d26-9571-26a46a24c47d None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:02.600622 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-7781b7d2-6cf3-4948-bfdc-18d4705cfa10 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:02.601863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-7781b7d2-6cf3-4948-bfdc-18d4705cfa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:02.639162 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e9d1f-79b0-41ae-ac53-5c0f2dad4d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:02.639779 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e9d1f-79b0-41ae-ac53-5c0f2dad4d3d None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:02.640629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e9d1f-79b0-41ae-ac53-5c0f2dad4d3d None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:02.647020 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e9d1f-79b0-41ae-ac53-5c0f2dad4d3d None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:02.647020 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e9d1f-79b0-41ae-ac53-5c0f2dad4d3d None admin] RBAC: Adding query filter params (name=member) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:02.647020 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e9d1f-79b0-41ae-ac53-5c0f2dad4d3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:02.647020 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e9d1f-79b0-41ae-ac53-5c0f2dad4d3d None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:02.653267 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 176/352] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:14:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:02.654559 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17257d5-1a56-4e10-916b-f67fbdf51998 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:02.654845 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17257d5-1a56-4e10-916b-f67fbdf51998 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:02.655153 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17257d5-1a56-4e10-916b-f67fbdf51998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:02.679255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-f17257d5-1a56-4e10-916b-f67fbdf51998 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:02.680404 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-f17257d5-1a56-4e10-916b-f67fbdf51998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:02.694190 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 177/353] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:02.695242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781b7d2-6cf3-4948-bfdc-18d4705cfa10 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:02.710725 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:02.723214 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:02.758594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 177/354] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:02.760075 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17257d5-1a56-4e10-916b-f67fbdf51998 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:02.815342 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781b7d2-6cf3-4948-bfdc-18d4705cfa10 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:02.863124 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a6177-c707-4f66-b833-215aefa037e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:02.864131 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a6177-c707-4f66-b833-215aefa037e1 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:02.864489 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a6177-c707-4f66-b833-215aefa037e1 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:02.864838 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a6177-c707-4f66-b833-215aefa037e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:02.881886 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17257d5-1a56-4e10-916b-f67fbdf51998 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:02.924836 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5692b9-9110-4b00-8993-fc16af1738ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:02.925560 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5692b9-9110-4b00-8993-fc16af1738ee None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:02.925867 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5692b9-9110-4b00-8993-fc16af1738ee None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:02.926214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5692b9-9110-4b00-8993-fc16af1738ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:02.954460 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a6177-c707-4f66-b833-215aefa037e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:02.956438 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a6177-c707-4f66-b833-215aefa037e1 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:02.967276 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:02.986126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:03.018211 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5692b9-9110-4b00-8993-fc16af1738ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:03.019795 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5692b9-9110-4b00-8993-fc16af1738ee None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:03.080468 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 178/355] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:03.081760 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311682ac-e557-408e-96e2-ab8d5eb6ef43 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:03.082044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311682ac-e557-408e-96e2-ab8d5eb6ef43 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:03.082328 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311682ac-e557-408e-96e2-ab8d5eb6ef43 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:03.083928 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 179/356] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:03.088858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311682ac-e557-408e-96e2-ab8d5eb6ef43 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:03.152543 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 178/357] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:03.153923 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c81ba-d422-465e-a089-7034efc1a458 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:03.154213 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c81ba-d422-465e-a089-7034efc1a458 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:03.154514 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c81ba-d422-465e-a089-7034efc1a458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:03.179672 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-0d8c81ba-d422-465e-a089-7034efc1a458 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:03.180871 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-0d8c81ba-d422-465e-a089-7034efc1a458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:03.209992 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311682ac-e557-408e-96e2-ab8d5eb6ef43 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:03.239671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:03.249343 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:03.259428 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7b066-5c68-4e2f-b42e-38d5d381ca07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:03.260433 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7b066-5c68-4e2f-b42e-38d5d381ca07 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:03.260796 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7b066-5c68-4e2f-b42e-38d5d381ca07 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:03.261126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7b066-5c68-4e2f-b42e-38d5d381ca07 None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:03.262375 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7b066-5c68-4e2f-b42e-38d5d381ca07 None admin] RBAC: Authorizing `identity:get_project(project_id=10ae72b6264047109854b2e9468e9ba3)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:03.263653 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 179/358] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:03.264376 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7b066-5c68-4e2f-b42e-38d5d381ca07 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:03.264552 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c81ba-d422-465e-a089-7034efc1a458 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:03.267812 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 180/359] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:03 2022] GET /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:03.269758 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7b066-5c68-4e2f-b42e-38d5d381ca07 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:03.396989 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c81ba-d422-465e-a089-7034efc1a458 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:03.421477 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7b066-5c68-4e2f-b42e-38d5d381ca07 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:03.442637 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516fe8e-2475-4a83-bb95-b199de8cfcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:03.443305 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516fe8e-2475-4a83-bb95-b199de8cfcd4 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:03.443585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516fe8e-2475-4a83-bb95-b199de8cfcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:03.443861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516fe8e-2475-4a83-bb95-b199de8cfcd4 None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:03.445010 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516fe8e-2475-4a83-bb95-b199de8cfcd4 None admin] RBAC: Authorizing `identity:get_project(project_id=60965deec4684d2f95fd5e6ebac6f77c)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:03.448035 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516fe8e-2475-4a83-bb95-b199de8cfcd4 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:03.451096 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 180/360] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:03 2022] GET /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:03.451895 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516fe8e-2475-4a83-bb95-b199de8cfcd4 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:03.471199 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1321b5-ef89-4569-a81a-aa85840cc1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:03.472209 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1321b5-ef89-4569-a81a-aa85840cc1bb None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:03.473068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1321b5-ef89-4569-a81a-aa85840cc1bb None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:03.473598 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1321b5-ef89-4569-a81a-aa85840cc1bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:03.489386 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1321b5-ef89-4569-a81a-aa85840cc1bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:03.494662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-de1321b5-ef89-4569-a81a-aa85840cc1bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:14:03.494662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:03.494662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:03.494662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:03.494662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:03.494662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:03.494662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:03.494662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:03.494662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:03.494662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:03.494662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:03.494662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:03.494662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:03.494662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:03.494662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:03.494662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:03.495618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:03.495618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:03.495618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:03.495618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:03.495618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:03.495618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:03.495618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:03.495618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:03.495618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:03.495618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:03.495618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:03.495618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:03.495618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:03.495618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:03.495618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:03.495618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:03.496429 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:03.496429 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:03.496429 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:03.496429 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:03.496429 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:03.496429 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:03.496429 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:03.496429 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:03.496429 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:03.496429 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:03.496429 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 00:14:03.496429 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:03.496429 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 181/361] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:03.497190 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1321b5-ef89-4569-a81a-aa85840cc1bb None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:03.543878 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:03.561020 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:03.590667 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516fe8e-2475-4a83-bb95-b199de8cfcd4 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:03.617038 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1321b5-ef89-4569-a81a-aa85840cc1bb None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:03.633845 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf4d68-fdb0-4d21-9511-9f2b550db13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:03.634767 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf4d68-fdb0-4d21-9511-9f2b550db13b None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:03.635285 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf4d68-fdb0-4d21-9511-9f2b550db13b None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:03.635748 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf4d68-fdb0-4d21-9511-9f2b550db13b None admin] PATH_INFO: `/v3/groups/f47970dca072475d935952796585962f` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:03.637013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf4d68-fdb0-4d21-9511-9f2b550db13b None admin] RBAC: Authorizing `identity:get_group(group_id=f47970dca072475d935952796585962f)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:03.638724 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf4d68-fdb0-4d21-9511-9f2b550db13b None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:03.640896 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 181/362] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 00:14:03 2022] GET /identity/v3/groups/f47970dca072475d935952796585962f => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:03.641743 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf4d68-fdb0-4d21-9511-9f2b550db13b None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:03.672169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac5ca3-a166-4aca-a1a3-b9ac8e019a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:03.672800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac5ca3-a166-4aca-a1a3-b9ac8e019a7e None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:03.673078 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac5ca3-a166-4aca-a1a3-b9ac8e019a7e None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:03.673350 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac5ca3-a166-4aca-a1a3-b9ac8e019a7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:03.690676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac5ca3-a166-4aca-a1a3-b9ac8e019a7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:03.697254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-54ac5ca3-a166-4aca-a1a3-b9ac8e019a7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:14:03.697254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:03.697254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:03.697254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:03.697254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:03.697254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:03.697254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:03.697254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:03.697254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:03.697254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:03.697254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:03.697254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:03.697254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:03.697254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:03.697254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:03.697254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:03.698188 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:03.698188 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:03.698188 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:03.698188 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:03.698188 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:03.698188 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:03.698188 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:03.698188 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:03.698188 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:03.698188 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:03.698188 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:03.698188 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:03.698188 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:03.698188 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:03.698188 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:03.698188 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:03.699024 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:03.699024 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:03.699024 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:03.699024 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:03.699024 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:03.699024 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:03.699024 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:03.699024 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:03.699024 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:03.699024 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:03.699024 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:14:03.699024 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:03.700604 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 182/363] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:14:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:03.701933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac5ca3-a166-4aca-a1a3-b9ac8e019a7e None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:03.778025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf4d68-fdb0-4d21-9511-9f2b550db13b None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:03.816661 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:03.825868 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79cd52-ac4d-434c-b347-6125147ce511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:03.826740 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79cd52-ac4d-434c-b347-6125147ce511 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:03.827067 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79cd52-ac4d-434c-b347-6125147ce511 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:03.827505 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79cd52-ac4d-434c-b347-6125147ce511 None admin] PATH_INFO: `/v3/groups/f47970dca072475d935952796585962f` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:03.828511 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79cd52-ac4d-434c-b347-6125147ce511 None admin] RBAC: Authorizing `identity:get_group(group_id=f47970dca072475d935952796585962f)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:03.829971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79cd52-ac4d-434c-b347-6125147ce511 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:03.831999 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 182/364] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 00:14:03 2022] GET /identity/v3/groups/f47970dca072475d935952796585962f => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:03.832858 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79cd52-ac4d-434c-b347-6125147ce511 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:03.837373 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac5ca3-a166-4aca-a1a3-b9ac8e019a7e None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:03.853730 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:03.882151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0342d-1da8-4077-837c-79b09919eced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:03.882870 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0342d-1da8-4077-837c-79b09919eced None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:03.883255 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0342d-1da8-4077-837c-79b09919eced None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:03.883602 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0342d-1da8-4077-837c-79b09919eced None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:03.884343 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0342d-1da8-4077-837c-79b09919eced None admin] RBAC: Adding query filter params (name=reader) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:03.884792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0342d-1da8-4077-837c-79b09919eced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:03.886308 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0342d-1da8-4077-837c-79b09919eced None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:03.900934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 183/365] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:14:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:03.900934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0342d-1da8-4077-837c-79b09919eced None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:03.984668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79cd52-ac4d-434c-b347-6125147ce511 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:04.029721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ee160-7da7-45f7-ac66-d2bf213bb58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:04.030257 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ee160-7da7-45f7-ac66-d2bf213bb58c None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:04.030624 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ee160-7da7-45f7-ac66-d2bf213bb58c None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:04.030903 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ee160-7da7-45f7-ac66-d2bf213bb58c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:04.032589 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ee160-7da7-45f7-ac66-d2bf213bb58c None admin] RBAC: Adding query filter params (group.id=f47970dca072475d935952796585962f, role.id=a7db20dbcb4b458d932c564bc9ad5bfb, scope.project.id=10ae72b6264047109854b2e9468e9ba3) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:04.032930 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ee160-7da7-45f7-ac66-d2bf213bb58c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:04.035719 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ee160-7da7-45f7-ac66-d2bf213bb58c None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:04.036878 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0342d-1da8-4077-837c-79b09919eced None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:04.042698 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 183/366] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 00:14:03 2022] GET /identity/v3/role_assignments?group.id=f47970dca072475d935952796585962f&scope.project.id=10ae72b6264047109854b2e9468e9ba3&role.id=a7db20dbcb4b458d932c564bc9ad5bfb => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:04.043563 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ee160-7da7-45f7-ac66-d2bf213bb58c None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:04.083218 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bf461-4bbb-4375-867b-666a01acd22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:04.084689 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bf461-4bbb-4375-867b-666a01acd22a None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:04.085192 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bf461-4bbb-4375-867b-666a01acd22a None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:04.085655 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bf461-4bbb-4375-867b-666a01acd22a None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:04.086552 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bf461-4bbb-4375-867b-666a01acd22a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:04.087132 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bf461-4bbb-4375-867b-666a01acd22a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:04.088768 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bf461-4bbb-4375-867b-666a01acd22a None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:04.100145 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 184/367] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:04.106030 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bf461-4bbb-4375-867b-666a01acd22a None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:04.137633 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:04.150205 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:04.198435 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ee160-7da7-45f7-ac66-d2bf213bb58c None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:04.246532 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bf461-4bbb-4375-867b-666a01acd22a None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:04.248957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf392fb5-3048-45a2-9655-c19b76518df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:04.250203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf392fb5-3048-45a2-9655-c19b76518df1 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:04.251592 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf392fb5-3048-45a2-9655-c19b76518df1 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:04.251592 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf392fb5-3048-45a2-9655-c19b76518df1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:04.268732 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf392fb5-3048-45a2-9655-c19b76518df1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:04.275302 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-bf392fb5-3048-45a2-9655-c19b76518df1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:04.275302 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:04.275302 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:04.275302 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:04.275302 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:04.275302 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:04.275302 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:04.275302 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:04.275302 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:04.275302 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:04.275302 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:04.275302 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:04.275302 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:04.275302 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:04.275302 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:04.275302 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:04.276255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:04.276255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:04.276255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:04.276255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:04.276255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:04.276255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:04.276255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:04.276255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:04.276255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:04.276255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:04.276255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:04.276255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:04.276255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:04.276255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:04.276255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:04.276255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:04.280946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:04.280946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:04.280946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:04.280946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:04.280946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:04.280946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:04.280946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:04.280946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:04.280946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:04.280946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:04.280946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:04.280946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:04.280946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 184/368] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 00:14:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:04.280946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf392fb5-3048-45a2-9655-c19b76518df1 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:04.304329 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca4ad7-0da5-4bab-9f08-93163c1a67b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:04.306143 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca4ad7-0da5-4bab-9f08-93163c1a67b0 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:04.306717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca4ad7-0da5-4bab-9f08-93163c1a67b0 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:04.307305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca4ad7-0da5-4bab-9f08-93163c1a67b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:04.308537 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca4ad7-0da5-4bab-9f08-93163c1a67b0 None admin] RBAC: Adding query filter params (group.id=f47970dca072475d935952796585962f, role.id=3fe3a1eb546b456aa3c8bce846a8d37f, scope.project.id=60965deec4684d2f95fd5e6ebac6f77c) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:04.309307 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca4ad7-0da5-4bab-9f08-93163c1a67b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:04.312221 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca4ad7-0da5-4bab-9f08-93163c1a67b0 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:04.320807 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 185/369] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 00:14:04 2022] GET /identity/v3/role_assignments?group.id=f47970dca072475d935952796585962f&scope.project.id=60965deec4684d2f95fd5e6ebac6f77c&role.id=3fe3a1eb546b456aa3c8bce846a8d37f => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:04.322171 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca4ad7-0da5-4bab-9f08-93163c1a67b0 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:04.431052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf392fb5-3048-45a2-9655-c19b76518df1 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:04.459477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:04.477913 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310221ef-f675-4203-8cba-186c4257a3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:04.478562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310221ef-f675-4203-8cba-186c4257a3a7 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:04.478842 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310221ef-f675-4203-8cba-186c4257a3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:04.479153 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310221ef-f675-4203-8cba-186c4257a3a7 None admin] PATH_INFO: `/v3/users/4571c3e694a6433ea5ff1da07ed3a07f` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:04.484561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310221ef-f675-4203-8cba-186c4257a3a7 None admin] RBAC: Authorizing `identity:get_user(user_id=4571c3e694a6433ea5ff1da07ed3a07f)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:04.486110 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310221ef-f675-4203-8cba-186c4257a3a7 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:04.491180 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 185/370] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 00:14:04 2022] GET /identity/v3/users/4571c3e694a6433ea5ff1da07ed3a07f => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:04.493698 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310221ef-f675-4203-8cba-186c4257a3a7 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:04.495544 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:04.501859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca4ad7-0da5-4bab-9f08-93163c1a67b0 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:04.551162 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e6aa8-3a25-4133-9aca-c730a6925086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:04.551813 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e6aa8-3a25-4133-9aca-c730a6925086 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:04.552101 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e6aa8-3a25-4133-9aca-c730a6925086 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:04.552378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e6aa8-3a25-4133-9aca-c730a6925086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:04.643432 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e6aa8-3a25-4133-9aca-c730a6925086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:04.645535 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e6aa8-3a25-4133-9aca-c730a6925086 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:04.646391 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310221ef-f675-4203-8cba-186c4257a3a7 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:04.693727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c627da1-6b96-4972-a94a-a9b58fbe203b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:04.694368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c627da1-6b96-4972-a94a-a9b58fbe203b None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:04.694645 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c627da1-6b96-4972-a94a-a9b58fbe203b None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:04.694919 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c627da1-6b96-4972-a94a-a9b58fbe203b None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:04.695621 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c627da1-6b96-4972-a94a-a9b58fbe203b None admin] RBAC: Adding query filter params (name=admin) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:04.695919 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c627da1-6b96-4972-a94a-a9b58fbe203b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:04.697937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c627da1-6b96-4972-a94a-a9b58fbe203b None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:04.708712 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 186/371] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:04.709760 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c627da1-6b96-4972-a94a-a9b58fbe203b None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:04.793873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:04.838144 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:04.842549 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 186/372] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:04.843810 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e6aa8-3a25-4133-9aca-c730a6925086 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:04.894570 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c627da1-6b96-4972-a94a-a9b58fbe203b None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:04.935361 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ae769-d66d-4b8d-85bb-263c4624631c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:04.935966 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ae769-d66d-4b8d-85bb-263c4624631c None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:04.936244 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ae769-d66d-4b8d-85bb-263c4624631c None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:04.936517 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ae769-d66d-4b8d-85bb-263c4624631c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:04.937872 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ae769-d66d-4b8d-85bb-263c4624631c None admin] RBAC: Adding query filter params (role.id=4eba322b310a4c6a8962dfb897571cf3, user.id=4571c3e694a6433ea5ff1da07ed3a07f, scope.system=all) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:04.938181 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ae769-d66d-4b8d-85bb-263c4624631c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:04.940920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ae769-d66d-4b8d-85bb-263c4624631c None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:04.956334 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 187/373] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Aug 24 00:14:04 2022] GET /identity/v3/role_assignments?user.id=4571c3e694a6433ea5ff1da07ed3a07f&scope.system=all&role.id=4eba322b310a4c6a8962dfb897571cf3 => generated 510 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:04.957463 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ae769-d66d-4b8d-85bb-263c4624631c None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:04.976722 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e6aa8-3a25-4133-9aca-c730a6925086 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:05.031320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381e1a8-05c3-4442-8abf-14fb5a7a12b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:05.032287 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381e1a8-05c3-4442-8abf-14fb5a7a12b3 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:05.032787 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381e1a8-05c3-4442-8abf-14fb5a7a12b3 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:05.033284 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381e1a8-05c3-4442-8abf-14fb5a7a12b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:05.138293 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:05.145792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381e1a8-05c3-4442-8abf-14fb5a7a12b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:05.147332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381e1a8-05c3-4442-8abf-14fb5a7a12b3 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:05.150945 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ae769-d66d-4b8d-85bb-263c4624631c None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:05.174149 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:05.215288 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0982b1-4915-4c72-b087-789aa4cd1ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:05.215946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0982b1-4915-4c72-b087-789aa4cd1ccd None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:05.216358 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0982b1-4915-4c72-b087-789aa4cd1ccd None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:05.216635 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0982b1-4915-4c72-b087-789aa4cd1ccd None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:05.217929 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0982b1-4915-4c72-b087-789aa4cd1ccd None admin] RBAC: Authorizing `identity:get_project(project_id=60965deec4684d2f95fd5e6ebac6f77c)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:05.219894 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0982b1-4915-4c72-b087-789aa4cd1ccd None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:05.229493 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 188/374] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:04 2022] GET /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:05.235616 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0982b1-4915-4c72-b087-789aa4cd1ccd None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:05.313730 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 187/375] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:05.320261 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381e1a8-05c3-4442-8abf-14fb5a7a12b3 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:05.437873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0982b1-4915-4c72-b087-789aa4cd1ccd None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:05.482884 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde2c3d-5252-491c-a930-2e9e278ba3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:05.484143 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde2c3d-5252-491c-a930-2e9e278ba3fb None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:05.484493 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde2c3d-5252-491c-a930-2e9e278ba3fb None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:05.484766 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde2c3d-5252-491c-a930-2e9e278ba3fb None admin] PATH_INFO: `/v3/groups/f47970dca072475d935952796585962f` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:05.485185 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:05.486897 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde2c3d-5252-491c-a930-2e9e278ba3fb None admin] RBAC: Authorizing `identity:get_group(group_id=f47970dca072475d935952796585962f)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:05.488608 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde2c3d-5252-491c-a930-2e9e278ba3fb None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:05.491312 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 189/376] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 00:14:05 2022] GET /identity/v3/groups/f47970dca072475d935952796585962f => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:05.493393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381e1a8-05c3-4442-8abf-14fb5a7a12b3 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:05.496251 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf718e-144a-4666-bc4e-082b1211c6b1 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:05.496545 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf718e-144a-4666-bc4e-082b1211c6b1 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:05.496813 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf718e-144a-4666-bc4e-082b1211c6b1 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:05.498398 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 190/377] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:05.501454 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf718e-144a-4666-bc4e-082b1211c6b1 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:05.545256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ac715-943b-4807-a7ca-d1dc9b77510e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:05.545887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ac715-943b-4807-a7ca-d1dc9b77510e None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:05.546694 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ac715-943b-4807-a7ca-d1dc9b77510e None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:05.546968 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ac715-943b-4807-a7ca-d1dc9b77510e None admin] PATH_INFO: `/v3/projects/792d367d504f4db2950fddd56501d7c3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:05.548141 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ac715-943b-4807-a7ca-d1dc9b77510e None admin] RBAC: Authorizing `identity:get_project(project_id=792d367d504f4db2950fddd56501d7c3)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:05.549613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ac715-943b-4807-a7ca-d1dc9b77510e None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:05.551593 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 188/378] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:05 2022] GET /identity/v3/projects/792d367d504f4db2950fddd56501d7c3 => generated 344 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:05.552755 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dff8b7-3b60-4a25-abcd-367587d3c640 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:05.553044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dff8b7-3b60-4a25-abcd-367587d3c640 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:05.553317 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dff8b7-3b60-4a25-abcd-367587d3c640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:05.566325 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:05.575549 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-c3dff8b7-3b60-4a25-abcd-367587d3c640 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:05.576763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-c3dff8b7-3b60-4a25-abcd-367587d3c640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:05.631750 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf718e-144a-4666-bc4e-082b1211c6b1 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:05.651516 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 189/379] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:05.652374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dff8b7-3b60-4a25-abcd-367587d3c640 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:05.669296 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63147fc2-60b8-418c-8cd9-e7e60da2c6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:05.669998 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63147fc2-60b8-418c-8cd9-e7e60da2c6b9 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:05.670275 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63147fc2-60b8-418c-8cd9-e7e60da2c6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:05.670636 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63147fc2-60b8-418c-8cd9-e7e60da2c6b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:05.671933 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63147fc2-60b8-418c-8cd9-e7e60da2c6b9 None admin] RBAC: Adding query filter params (group.id=f47970dca072475d935952796585962f, role.id=a7db20dbcb4b458d932c564bc9ad5bfb, scope.project.id=60965deec4684d2f95fd5e6ebac6f77c) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:05.672696 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63147fc2-60b8-418c-8cd9-e7e60da2c6b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:05.673748 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63147fc2-60b8-418c-8cd9-e7e60da2c6b9 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:05.687435 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 191/380] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 00:14:05 2022] GET /identity/v3/role_assignments?group.id=f47970dca072475d935952796585962f&scope.project.id=60965deec4684d2f95fd5e6ebac6f77c&role.id=a7db20dbcb4b458d932c564bc9ad5bfb => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:05.762691 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dff8b7-3b60-4a25-abcd-367587d3c640 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:05.771444 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:05.802659 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db254681-cfef-481e-84ef-437b4b0b789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:05.803344 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254681-cfef-481e-84ef-437b4b0b789e None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:05.803625 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254681-cfef-481e-84ef-437b4b0b789e None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:05.803895 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254681-cfef-481e-84ef-437b4b0b789e None admin] PATH_INFO: `/v3/groups/1179533c85644cb8a44315ecadb735fc` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:05.809609 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db254681-cfef-481e-84ef-437b4b0b789e None admin] RBAC: Authorizing `identity:get_group(group_id=1179533c85644cb8a44315ecadb735fc)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:05.811187 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db254681-cfef-481e-84ef-437b4b0b789e None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:05.813384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 190/381] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 00:14:05 2022] GET /identity/v3/groups/1179533c85644cb8a44315ecadb735fc => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:05.820320 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63147fc2-60b8-418c-8cd9-e7e60da2c6b9 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:05.939975 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63147fc2-60b8-418c-8cd9-e7e60da2c6b9 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:05.954842 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:05.991966 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ab8b6-8b43-4919-803c-4fb4d8f66a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:05.992562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ab8b6-8b43-4919-803c-4fb4d8f66a25 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:05.992842 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ab8b6-8b43-4919-803c-4fb4d8f66a25 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:05.993160 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ab8b6-8b43-4919-803c-4fb4d8f66a25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:05.993851 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ab8b6-8b43-4919-803c-4fb4d8f66a25 None admin] RBAC: Adding query filter params (group.id=1179533c85644cb8a44315ecadb735fc, role.id=9b372d4fe82a4a54a3ecd29e7b912586, scope.project.id=792d367d504f4db2950fddd56501d7c3) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:05.994158 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ab8b6-8b43-4919-803c-4fb4d8f66a25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:05.995638 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ab8b6-8b43-4919-803c-4fb4d8f66a25 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:06.002600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 192/382] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 00:14:05 2022] GET /identity/v3/role_assignments?group.id=1179533c85644cb8a44315ecadb735fc&scope.project.id=792d367d504f4db2950fddd56501d7c3&role.id=9b372d4fe82a4a54a3ecd29e7b912586 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:06.180652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db254681-cfef-481e-84ef-437b4b0b789e None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:06.305396 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db254681-cfef-481e-84ef-437b4b0b789e None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:06.341895 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebec40-1007-4172-8bc2-a1c0ba5c939f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:06.342640 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebec40-1007-4172-8bc2-a1c0ba5c939f None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:06.342889 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebec40-1007-4172-8bc2-a1c0ba5c939f None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:06.343204 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebec40-1007-4172-8bc2-a1c0ba5c939f None admin] PATH_INFO: `/v3/roles/member` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:06.353662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebec40-1007-4172-8bc2-a1c0ba5c939f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:06.358934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-97ebec40-1007-4172-8bc2-a1c0ba5c939f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:06.358934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:06.358934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:06.358934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:06.358934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:06.358934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:06.358934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:06.358934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:06.358934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:06.358934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:06.358934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:06.358934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:06.358934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:06.358934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:06.358934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:06.358934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:06.359809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:06.359809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:06.359809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:06.359809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:06.359809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:06.359809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:06.359809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:06.359809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:06.359809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:06.359809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:06.359809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:06.359809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:06.359809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:06.359809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:06.359809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:06.359809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:06.360591 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:06.360591 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:06.360591 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:06.360591 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:06.360591 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:06.360591 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:06.360591 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:06.360591 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:06.360591 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:06.360591 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:06.360591 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:06.360591 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:06.360591 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 191/383] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:06.367186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ab8b6-8b43-4919-803c-4fb4d8f66a25 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:06.514929 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ab8b6-8b43-4919-803c-4fb4d8f66a25 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:06.571749 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26afbb-c456-45ee-967e-f275ecb99bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:06.572377 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26afbb-c456-45ee-967e-f275ecb99bd2 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:06.572656 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26afbb-c456-45ee-967e-f275ecb99bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:06.572997 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26afbb-c456-45ee-967e-f275ecb99bd2 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:06.573676 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26afbb-c456-45ee-967e-f275ecb99bd2 None admin] RBAC: Adding query filter params (name=member) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:06.573980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26afbb-c456-45ee-967e-f275ecb99bd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:06.575400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26afbb-c456-45ee-967e-f275ecb99bd2 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:06.584689 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 193/384] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:14:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:06.590081 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebec40-1007-4172-8bc2-a1c0ba5c939f None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:06.631284 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:06.729423 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebec40-1007-4172-8bc2-a1c0ba5c939f None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:06.784556 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e516c5-6929-4804-b5c1-de88712d2fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:06.785108 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e516c5-6929-4804-b5c1-de88712d2fb0 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:06.785386 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e516c5-6929-4804-b5c1-de88712d2fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:06.785661 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e516c5-6929-4804-b5c1-de88712d2fb0 None admin] PATH_INFO: `/v3/groups/f47970dca072475d935952796585962f` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:06.786800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e516c5-6929-4804-b5c1-de88712d2fb0 None admin] RBAC: Authorizing `identity:get_group(group_id=f47970dca072475d935952796585962f)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:06.788372 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e516c5-6929-4804-b5c1-de88712d2fb0 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:06.790265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 192/385] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 00:14:06 2022] GET /identity/v3/groups/f47970dca072475d935952796585962f => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:06.795882 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26afbb-c456-45ee-967e-f275ecb99bd2 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:06.844775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:06.938488 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26afbb-c456-45ee-967e-f275ecb99bd2 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:06.987712 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5a271-4d2a-410b-afba-1b86f85b6445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:06.988395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5a271-4d2a-410b-afba-1b86f85b6445 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:06.988676 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5a271-4d2a-410b-afba-1b86f85b6445 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:06.988952 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5a271-4d2a-410b-afba-1b86f85b6445 None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:06.990446 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5a271-4d2a-410b-afba-1b86f85b6445 None admin] RBAC: Authorizing `identity:get_project(project_id=10ae72b6264047109854b2e9468e9ba3)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:06.991943 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5a271-4d2a-410b-afba-1b86f85b6445 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:06.993755 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 194/386] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:06 2022] GET /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:06.999621 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e516c5-6929-4804-b5c1-de88712d2fb0 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:07.107554 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09794669-eed5-4d4b-9b4f-c0f228a787df None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:07.107768 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09794669-eed5-4d4b-9b4f-c0f228a787df None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:07.108049 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09794669-eed5-4d4b-9b4f-c0f228a787df None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:07.109618 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 195/387] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:14:07.116342 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adc41a-61c6-40bd-896a-5e33ddb09c9e None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:07.116621 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adc41a-61c6-40bd-896a-5e33ddb09c9e None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:07.116893 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adc41a-61c6-40bd-896a-5e33ddb09c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:07.152411 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-c9adc41a-61c6-40bd-896a-5e33ddb09c9e None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:07.154609 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-c9adc41a-61c6-40bd-896a-5e33ddb09c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:07.171349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:07.187680 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e516c5-6929-4804-b5c1-de88712d2fb0 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:07.280519 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 196/388] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:14:07.291323 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247e4b0-4619-40a8-aa75-2f7cacd41b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:07.292265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247e4b0-4619-40a8-aa75-2f7cacd41b7e None admin] REQUEST_METHOD: `PUT` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:07.292719 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247e4b0-4619-40a8-aa75-2f7cacd41b7e None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:07.293148 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247e4b0-4619-40a8-aa75-2f7cacd41b7e None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3/groups/f47970dca072475d935952796585962f/roles/3fe3a1eb546b456aa3c8bce846a8d37f` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:07.299810 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247e4b0-4619-40a8-aa75-2f7cacd41b7e None admin] RBAC: Authorizing `identity:create_grant(project_id=10ae72b6264047109854b2e9468e9ba3, group_id=f47970dca072475d935952796585962f, role_id=3fe3a1eb546b456aa3c8bce846a8d37f)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:07.301460 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247e4b0-4619-40a8-aa75-2f7cacd41b7e None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:07.324440 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 193/389] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 24 00:14:06 2022] PUT /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3/groups/f47970dca072475d935952796585962f/roles/3fe3a1eb546b456aa3c8bce846a8d37f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:14:07.669555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9adc41a-61c6-40bd-896a-5e33ddb09c9e None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:07.709016 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:07.784123 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9adc41a-61c6-40bd-896a-5e33ddb09c9e None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:07.820787 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc53584-71ca-4e46-9ad6-88dbb92417b6 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:07.821282 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc53584-71ca-4e46-9ad6-88dbb92417b6 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:07.821384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc53584-71ca-4e46-9ad6-88dbb92417b6 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:07.822902 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 194/390] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:07.828621 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079994d-6d1f-43e7-aaeb-4c55a30d51db None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:07.828888 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079994d-6d1f-43e7-aaeb-4c55a30d51db None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:07.829171 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079994d-6d1f-43e7-aaeb-4c55a30d51db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:07.837279 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae0797-1205-4e27-a91e-45a25f0560a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:07.838278 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae0797-1205-4e27-a91e-45a25f0560a5 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:07.838772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae0797-1205-4e27-a91e-45a25f0560a5 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:07.839298 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae0797-1205-4e27-a91e-45a25f0560a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:07.849226 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-d079994d-6d1f-43e7-aaeb-4c55a30d51db None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:07.850511 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-d079994d-6d1f-43e7-aaeb-4c55a30d51db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:07.857916 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae0797-1205-4e27-a91e-45a25f0560a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:07.863642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-f7ae0797-1205-4e27-a91e-45a25f0560a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:14:07.863642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:07.863642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:07.863642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:07.863642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:07.863642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:07.863642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:07.863642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:07.863642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:07.863642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:07.863642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:07.863642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:07.863642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:07.863642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:07.863642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:07.863642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:07.864527 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:07.864527 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:07.864527 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:07.864527 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:07.864527 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:07.864527 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:07.864527 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:07.864527 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:07.864527 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:07.864527 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:07.864527 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:07.864527 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:07.864527 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:07.864527 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:07.864527 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:07.864527 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:07.865363 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:07.865363 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:07.865363 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:07.865363 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:07.865363 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:07.865363 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:07.865363 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:07.865363 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:07.865363 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:07.865363 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:07.865363 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:14:07.865363 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:07.867763 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 197/391] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:14:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:07.873624 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae0797-1205-4e27-a91e-45a25f0560a5 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:07.942104 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 195/392] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:14:08.001022 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:08.013138 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae0797-1205-4e27-a91e-45a25f0560a5 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:08.068382 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13b2ab-7bb2-4e93-ad0d-188b2d9b0501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:08.069289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13b2ab-7bb2-4e93-ad0d-188b2d9b0501 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:08.069720 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13b2ab-7bb2-4e93-ad0d-188b2d9b0501 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:08.070000 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13b2ab-7bb2-4e93-ad0d-188b2d9b0501 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:08.070672 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13b2ab-7bb2-4e93-ad0d-188b2d9b0501 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:08.070973 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13b2ab-7bb2-4e93-ad0d-188b2d9b0501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:08.072375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13b2ab-7bb2-4e93-ad0d-188b2d9b0501 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:08.086641 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 198/393] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:08.091901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079994d-6d1f-43e7-aaeb-4c55a30d51db None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:08.199846 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:08.220906 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079994d-6d1f-43e7-aaeb-4c55a30d51db None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:08.265707 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c5675-3b88-463e-9c21-6ee11264d740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:08.266345 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c5675-3b88-463e-9c21-6ee11264d740 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:08.266622 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c5675-3b88-463e-9c21-6ee11264d740 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:08.266895 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c5675-3b88-463e-9c21-6ee11264d740 None admin] PATH_INFO: `/v3/groups/f47970dca072475d935952796585962f` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:08.271684 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c5675-3b88-463e-9c21-6ee11264d740 None admin] RBAC: Authorizing `identity:get_group(group_id=f47970dca072475d935952796585962f)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:08.273132 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c5675-3b88-463e-9c21-6ee11264d740 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:08.274815 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 196/394] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 00:14:08 2022] GET /identity/v3/groups/f47970dca072475d935952796585962f => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:08.280844 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13b2ab-7bb2-4e93-ad0d-188b2d9b0501 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:08.402050 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c5675-3b88-463e-9c21-6ee11264d740 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:08.422174 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13b2ab-7bb2-4e93-ad0d-188b2d9b0501 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:08.472690 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7a50b-7cd7-46a6-a215-1d07c837736d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:08.473685 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7a50b-7cd7-46a6-a215-1d07c837736d None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:08.474208 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7a50b-7cd7-46a6-a215-1d07c837736d None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:08.474681 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7a50b-7cd7-46a6-a215-1d07c837736d None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:08.479704 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7a50b-7cd7-46a6-a215-1d07c837736d None admin] RBAC: Authorizing `identity:get_project(project_id=10ae72b6264047109854b2e9468e9ba3)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:08.481170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7a50b-7cd7-46a6-a215-1d07c837736d None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:08.487020 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 199/395] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:08 2022] GET /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:08.489864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7a50b-7cd7-46a6-a215-1d07c837736d None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:08.547390 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:08.599235 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c5675-3b88-463e-9c21-6ee11264d740 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:08.657059 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7a50b-7cd7-46a6-a215-1d07c837736d None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:08.671034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a5270-c492-431c-9036-efcac1dba5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:08.672091 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a5270-c492-431c-9036-efcac1dba5bf None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:08.672653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a5270-c492-431c-9036-efcac1dba5bf None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:08.673137 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a5270-c492-431c-9036-efcac1dba5bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:08.692022 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19453e57-3541-412d-b51e-2a5f02004e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:08.692671 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19453e57-3541-412d-b51e-2a5f02004e39 None admin] REQUEST_METHOD: `PUT` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:08.692960 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19453e57-3541-412d-b51e-2a5f02004e39 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:08.693241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19453e57-3541-412d-b51e-2a5f02004e39 None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3/groups/f47970dca072475d935952796585962f/roles/a7db20dbcb4b458d932c564bc9ad5bfb` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:08.699615 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a5270-c492-431c-9036-efcac1dba5bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:08.700453 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19453e57-3541-412d-b51e-2a5f02004e39 None admin] RBAC: Authorizing `identity:create_grant(project_id=10ae72b6264047109854b2e9468e9ba3, group_id=f47970dca072475d935952796585962f, role_id=a7db20dbcb4b458d932c564bc9ad5bfb)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:08.701949 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19453e57-3541-412d-b51e-2a5f02004e39 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:08.705355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-0d6a5270-c492-431c-9036-efcac1dba5bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:08.705355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:08.705355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:08.705355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:08.705355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:08.705355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:08.705355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:08.705355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:08.705355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:08.705355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:08.705355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:08.705355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:08.705355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:08.705355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:08.705355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:08.705355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:08.706211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:08.706211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:08.706211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:08.706211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:08.706211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:08.706211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:08.706211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:08.706211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:08.706211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:08.706211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:08.706211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:08.706211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:08.706211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:08.706211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:08.706211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:08.706211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:08.707033 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:08.707033 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:08.707033 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:08.707033 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:08.707033 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:08.707033 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:08.707033 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:08.707033 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:08.707033 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:08.707033 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:08.707033 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:08.707033 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:08.707655 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 197/396] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:08.708674 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4ca98-7e55-43b0-99de-00edadcdcb98 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:08.708962 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4ca98-7e55-43b0-99de-00edadcdcb98 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:08.709237 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4ca98-7e55-43b0-99de-00edadcdcb98 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:08.710981 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 198/397] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:08.714945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4ca98-7e55-43b0-99de-00edadcdcb98 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:08.722438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 200/398] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 24 00:14:08 2022] PUT /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3/groups/f47970dca072475d935952796585962f/roles/a7db20dbcb4b458d932c564bc9ad5bfb => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 00:14:08.728552 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5a2b0-02d1-47b4-9051-38a17141fcbb None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:08.729241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5a2b0-02d1-47b4-9051-38a17141fcbb None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:08.729748 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5a2b0-02d1-47b4-9051-38a17141fcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:08.740071 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:08.776459 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-ffc5a2b0-02d1-47b4-9051-38a17141fcbb None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:08.778177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-ffc5a2b0-02d1-47b4-9051-38a17141fcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:08.907838 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4ca98-7e55-43b0-99de-00edadcdcb98 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:08.924345 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 201/399] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:08.924345 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e153b-c360-4fcf-a3f4-79945c1a1994 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:08.925471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e153b-c360-4fcf-a3f4-79945c1a1994 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:08.925751 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e153b-c360-4fcf-a3f4-79945c1a1994 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:08.927177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 202/400] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:08.944165 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c2399-4769-4c16-89e9-cdd6097f00a6 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:08.944787 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c2399-4769-4c16-89e9-cdd6097f00a6 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:08.945258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c2399-4769-4c16-89e9-cdd6097f00a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:08.956582 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef744f-bb41-4d32-8126-00a599745c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:08.957256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef744f-bb41-4d32-8126-00a599745c00 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:08.957539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef744f-bb41-4d32-8126-00a599745c00 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:08.957819 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef744f-bb41-4d32-8126-00a599745c00 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:08.958547 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef744f-bb41-4d32-8126-00a599745c00 None admin] RBAC: Adding query filter params (name=member) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:08.958854 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef744f-bb41-4d32-8126-00a599745c00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:08.960472 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef744f-bb41-4d32-8126-00a599745c00 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:08.967358 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-d85c2399-4769-4c16-89e9-cdd6097f00a6 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:08.968840 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-d85c2399-4769-4c16-89e9-cdd6097f00a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:08.971144 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 199/401] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:14:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:08.978084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef744f-bb41-4d32-8126-00a599745c00 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:08.980845 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:09.041977 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 203/402] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:14:09.062597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:09.095941 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef744f-bb41-4d32-8126-00a599745c00 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:09.131893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7df69-32e3-40a4-b15a-4d17fa90ef46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:09.132862 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7df69-32e3-40a4-b15a-4d17fa90ef46 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:09.133343 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7df69-32e3-40a4-b15a-4d17fa90ef46 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:09.133841 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7df69-32e3-40a4-b15a-4d17fa90ef46 None admin] PATH_INFO: `/v3/groups/f47970dca072475d935952796585962f` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:09.135260 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7df69-32e3-40a4-b15a-4d17fa90ef46 None admin] RBAC: Authorizing `identity:get_group(group_id=f47970dca072475d935952796585962f)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:09.136962 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7df69-32e3-40a4-b15a-4d17fa90ef46 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:09.139097 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 200/403] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 00:14:08 2022] GET /identity/v3/groups/f47970dca072475d935952796585962f => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:09.148089 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c2399-4769-4c16-89e9-cdd6097f00a6 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:09.289864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c2399-4769-4c16-89e9-cdd6097f00a6 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:09.329768 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7df69-32e3-40a4-b15a-4d17fa90ef46 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:09.343490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bea9c-6247-4d6e-8018-08ea6418846f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:09.344128 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bea9c-6247-4d6e-8018-08ea6418846f None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:09.344408 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bea9c-6247-4d6e-8018-08ea6418846f None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:09.344679 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bea9c-6247-4d6e-8018-08ea6418846f None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:09.345826 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bea9c-6247-4d6e-8018-08ea6418846f None admin] RBAC: Authorizing `identity:get_project(project_id=60965deec4684d2f95fd5e6ebac6f77c)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:09.347309 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bea9c-6247-4d6e-8018-08ea6418846f None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:09.349252 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 204/404] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:09 2022] GET /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:09.355488 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bea9c-6247-4d6e-8018-08ea6418846f None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:09.378467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:09.509324 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7df69-32e3-40a4-b15a-4d17fa90ef46 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:09.535436 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bea9c-6247-4d6e-8018-08ea6418846f None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:09.563907 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c71d07-86a2-4620-b860-04881d70a801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:09.564960 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c71d07-86a2-4620-b860-04881d70a801 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:09.565663 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c71d07-86a2-4620-b860-04881d70a801 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:09.565945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c71d07-86a2-4620-b860-04881d70a801 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:09.575428 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:09.577744 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933bf1d-076c-4ac7-aa02-1778380a1dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:09.578948 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933bf1d-076c-4ac7-aa02-1778380a1dd3 None admin] REQUEST_METHOD: `PUT` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:09.579426 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933bf1d-076c-4ac7-aa02-1778380a1dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:09.580622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933bf1d-076c-4ac7-aa02-1778380a1dd3 None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c/groups/f47970dca072475d935952796585962f/roles/3fe3a1eb546b456aa3c8bce846a8d37f` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:09.580854 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c71d07-86a2-4620-b860-04881d70a801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:09.582970 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933bf1d-076c-4ac7-aa02-1778380a1dd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=60965deec4684d2f95fd5e6ebac6f77c, group_id=f47970dca072475d935952796585962f, role_id=3fe3a1eb546b456aa3c8bce846a8d37f)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:09.584574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933bf1d-076c-4ac7-aa02-1778380a1dd3 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:09.586648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-10c71d07-86a2-4620-b860-04881d70a801 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:14:09.586648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:09.586648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:09.586648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:09.586648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:09.586648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:09.586648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:09.586648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:09.586648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:09.586648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:09.586648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:09.586648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:09.586648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:09.586648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:09.586648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:09.586648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:09.587741 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:09.587741 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:09.587741 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:09.587741 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:09.587741 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:09.587741 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:09.587741 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:09.587741 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:09.587741 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:09.587741 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:09.587741 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:09.587741 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:09.587741 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:09.587741 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:09.587741 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:09.587741 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:09.588573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:09.588573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:09.588573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:09.588573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:09.588573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:09.588573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:09.588573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:09.588573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:09.588573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:09.588573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:09.588573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:14:09.588573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:09.591136 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 201/405] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:14:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:09.592064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c71d07-86a2-4620-b860-04881d70a801 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:09.614227 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 205/406] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 24 00:14:09 2022] PUT /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c/groups/f47970dca072475d935952796585962f/roles/3fe3a1eb546b456aa3c8bce846a8d37f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 00:14:09.615473 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933bf1d-076c-4ac7-aa02-1778380a1dd3 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:09.701846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:09.741662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933bf1d-076c-4ac7-aa02-1778380a1dd3 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:09.750747 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c71d07-86a2-4620-b860-04881d70a801 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:09.789931 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792743c8-0ca3-4df1-94ea-12d95055fb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:09.791699 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792743c8-0ca3-4df1-94ea-12d95055fb7f None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:09.793346 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792743c8-0ca3-4df1-94ea-12d95055fb7f None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:09.793994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792743c8-0ca3-4df1-94ea-12d95055fb7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:09.794850 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586b6ef-ba52-4edc-8ae9-1b6e79db52a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:09.798367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586b6ef-ba52-4edc-8ae9-1b6e79db52a7 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:09.798870 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586b6ef-ba52-4edc-8ae9-1b6e79db52a7 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:09.799613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586b6ef-ba52-4edc-8ae9-1b6e79db52a7 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:09.801050 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586b6ef-ba52-4edc-8ae9-1b6e79db52a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:09.802035 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586b6ef-ba52-4edc-8ae9-1b6e79db52a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:09.806164 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586b6ef-ba52-4edc-8ae9-1b6e79db52a7 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:09.821946 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792743c8-0ca3-4df1-94ea-12d95055fb7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:09.824581 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 206/407] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:09.828237 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586b6ef-ba52-4edc-8ae9-1b6e79db52a7 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:09.834939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-792743c8-0ca3-4df1-94ea-12d95055fb7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:09.834939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:09.834939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:09.834939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:09.834939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:09.834939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:09.834939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:09.834939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:09.834939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:09.834939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:09.834939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:09.834939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:09.834939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:09.834939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:09.834939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:09.834939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:09.835908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:09.835908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:09.835908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:09.835908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:09.835908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:09.835908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:09.835908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:09.835908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:09.835908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:09.835908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:09.835908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:09.835908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:09.835908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:09.835908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:09.835908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:09.835908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:09.836677 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:09.836677 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:09.836677 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:09.836677 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:09.836677 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:09.836677 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:09.836677 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:09.836677 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:09.836677 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:09.836677 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:09.836677 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:09.836677 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:09.839120 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 202/408] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 00:14:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:09.845940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792743c8-0ca3-4df1-94ea-12d95055fb7f None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:09.941930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:09.985796 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586b6ef-ba52-4edc-8ae9-1b6e79db52a7 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:10.006015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792743c8-0ca3-4df1-94ea-12d95055fb7f None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:10.026039 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d626a49-682c-4249-b7d7-32ff0d2d78ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:10.027125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d626a49-682c-4249-b7d7-32ff0d2d78ad None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:10.027612 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d626a49-682c-4249-b7d7-32ff0d2d78ad None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:10.028092 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d626a49-682c-4249-b7d7-32ff0d2d78ad None admin] PATH_INFO: `/v3/groups/f47970dca072475d935952796585962f` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:10.029733 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d626a49-682c-4249-b7d7-32ff0d2d78ad None admin] RBAC: Authorizing `identity:get_group(group_id=f47970dca072475d935952796585962f)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:10.032126 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d626a49-682c-4249-b7d7-32ff0d2d78ad None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:10.034347 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 207/409] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 00:14:09 2022] GET /identity/v3/groups/f47970dca072475d935952796585962f => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:10.039771 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d626a49-682c-4249-b7d7-32ff0d2d78ad None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:10.043320 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:10.062968 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed7a4b-1831-4e6d-b40d-57d58be914c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:10.063861 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed7a4b-1831-4e6d-b40d-57d58be914c7 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:10.064548 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed7a4b-1831-4e6d-b40d-57d58be914c7 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:10.065076 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed7a4b-1831-4e6d-b40d-57d58be914c7 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:10.065909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed7a4b-1831-4e6d-b40d-57d58be914c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:10.066361 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed7a4b-1831-4e6d-b40d-57d58be914c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:10.068079 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed7a4b-1831-4e6d-b40d-57d58be914c7 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:10.091027 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 203/410] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:10.095494 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed7a4b-1831-4e6d-b40d-57d58be914c7 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:10.236837 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d626a49-682c-4249-b7d7-32ff0d2d78ad None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:10.276980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed7a4b-1831-4e6d-b40d-57d58be914c7 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:10.285301 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118d035-8cc1-4e57-a4c6-f2b3b4ef5e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:10.286547 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118d035-8cc1-4e57-a4c6-f2b3b4ef5e9b None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:10.287037 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118d035-8cc1-4e57-a4c6-f2b3b4ef5e9b None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:10.287477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118d035-8cc1-4e57-a4c6-f2b3b4ef5e9b None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:10.288776 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118d035-8cc1-4e57-a4c6-f2b3b4ef5e9b None admin] RBAC: Authorizing `identity:get_project(project_id=60965deec4684d2f95fd5e6ebac6f77c)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:10.291191 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118d035-8cc1-4e57-a4c6-f2b3b4ef5e9b None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:10.294301 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 208/411] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:10 2022] GET /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:10.296569 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b49e16-cd92-4a10-bbb1-53c2e1e088a1 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:10.297003 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b49e16-cd92-4a10-bbb1-53c2e1e088a1 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:10.297576 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b49e16-cd92-4a10-bbb1-53c2e1e088a1 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:10.299662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 209/412] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:10.300489 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b49e16-cd92-4a10-bbb1-53c2e1e088a1 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:10.305124 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:10.321454 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8b343-ffdb-416f-882c-595622f163a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:10.322092 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8b343-ffdb-416f-882c-595622f163a0 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:10.322380 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8b343-ffdb-416f-882c-595622f163a0 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:10.322658 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8b343-ffdb-416f-882c-595622f163a0 None admin] PATH_INFO: `/v3/groups/1179533c85644cb8a44315ecadb735fc` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:10.323902 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8b343-ffdb-416f-882c-595622f163a0 None admin] RBAC: Authorizing `identity:get_group(group_id=1179533c85644cb8a44315ecadb735fc)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:10.325461 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8b343-ffdb-416f-882c-595622f163a0 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:10.331792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 204/413] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 00:14:10 2022] GET /identity/v3/groups/1179533c85644cb8a44315ecadb735fc => generated 229 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:10.332998 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee368203-d4d9-40b7-a7c3-11e85140eddd None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:10.333288 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee368203-d4d9-40b7-a7c3-11e85140eddd None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:10.333650 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee368203-d4d9-40b7-a7c3-11e85140eddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:10.355367 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-ee368203-d4d9-40b7-a7c3-11e85140eddd None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:10.356957 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-ee368203-d4d9-40b7-a7c3-11e85140eddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:10.392388 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:10.443754 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b49e16-cd92-4a10-bbb1-53c2e1e088a1 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:10.454704 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 205/414] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:10.456225 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee368203-d4d9-40b7-a7c3-11e85140eddd None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:10.483171 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c125d-7b07-4b82-a04b-e79bd5ed8055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:10.484189 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c125d-7b07-4b82-a04b-e79bd5ed8055 None admin] REQUEST_METHOD: `PUT` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:10.484453 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c125d-7b07-4b82-a04b-e79bd5ed8055 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:10.484729 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c125d-7b07-4b82-a04b-e79bd5ed8055 None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c/groups/f47970dca072475d935952796585962f/roles/a7db20dbcb4b458d932c564bc9ad5bfb` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:10.491785 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c125d-7b07-4b82-a04b-e79bd5ed8055 None admin] RBAC: Authorizing `identity:create_grant(project_id=60965deec4684d2f95fd5e6ebac6f77c, group_id=f47970dca072475d935952796585962f, role_id=a7db20dbcb4b458d932c564bc9ad5bfb)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:10.493767 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c125d-7b07-4b82-a04b-e79bd5ed8055 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:10.523177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 210/415] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 24 00:14:10 2022] PUT /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c/groups/f47970dca072475d935952796585962f/roles/a7db20dbcb4b458d932c564bc9ad5bfb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:14:10.604302 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee368203-d4d9-40b7-a7c3-11e85140eddd None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:10.630888 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:10.652882 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1c9af-fde7-4986-a70a-a3254b065423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:10.653586 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1c9af-fde7-4986-a70a-a3254b065423 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:10.653867 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1c9af-fde7-4986-a70a-a3254b065423 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:10.654139 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1c9af-fde7-4986-a70a-a3254b065423 None admin] PATH_INFO: `/v3/projects/792d367d504f4db2950fddd56501d7c3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:10.656024 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1c9af-fde7-4986-a70a-a3254b065423 None admin] RBAC: Authorizing `identity:get_project(project_id=792d367d504f4db2950fddd56501d7c3)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:10.657578 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1c9af-fde7-4986-a70a-a3254b065423 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:10.662838 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 206/416] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:10 2022] GET /identity/v3/projects/792d367d504f4db2950fddd56501d7c3 => generated 344 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:10.666364 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c125d-7b07-4b82-a04b-e79bd5ed8055 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:10.798007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c125d-7b07-4b82-a04b-e79bd5ed8055 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:10.830197 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:10.837554 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832b6a1-fb89-42f1-aed1-c1f0dcefc426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:10.838229 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832b6a1-fb89-42f1-aed1-c1f0dcefc426 None admin] REQUEST_METHOD: `PUT` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:10.838506 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832b6a1-fb89-42f1-aed1-c1f0dcefc426 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:10.838832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832b6a1-fb89-42f1-aed1-c1f0dcefc426 None admin] PATH_INFO: `/v3/projects/792d367d504f4db2950fddd56501d7c3/groups/1179533c85644cb8a44315ecadb735fc/roles/9b372d4fe82a4a54a3ecd29e7b912586` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:10.841284 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832b6a1-fb89-42f1-aed1-c1f0dcefc426 None admin] RBAC: Authorizing `identity:create_grant(project_id=792d367d504f4db2950fddd56501d7c3, group_id=1179533c85644cb8a44315ecadb735fc, role_id=9b372d4fe82a4a54a3ecd29e7b912586)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:10.843362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832b6a1-fb89-42f1-aed1-c1f0dcefc426 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:10.859897 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 211/417] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 24 00:14:10 2022] PUT /identity/v3/projects/792d367d504f4db2950fddd56501d7c3/groups/1179533c85644cb8a44315ecadb735fc/roles/9b372d4fe82a4a54a3ecd29e7b912586 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:14:11.022332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1c9af-fde7-4986-a70a-a3254b065423 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:11.168315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1c9af-fde7-4986-a70a-a3254b065423 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:11.220633 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc1248-125e-45dd-9672-551e29e781f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:11.221285 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc1248-125e-45dd-9672-551e29e781f7 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:11.221568 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc1248-125e-45dd-9672-551e29e781f7 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:11.221844 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc1248-125e-45dd-9672-551e29e781f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:11.239365 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc1248-125e-45dd-9672-551e29e781f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:11.248085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-7abc1248-125e-45dd-9672-551e29e781f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:11.248085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:11.248085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:11.248085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:11.248085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:11.248085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:11.248085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:11.248085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:11.248085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:11.248085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:11.248085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:11.248085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:11.248085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:11.248085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:11.248085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:11.248085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:11.251133 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:11.251133 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:11.251133 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:11.251133 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:11.251133 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:11.251133 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:11.251133 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:11.251133 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:11.251133 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:11.251133 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:11.251133 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:11.251133 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:11.251133 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:11.251133 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:11.251133 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:11.251133 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:11.253126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:11.253126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:11.253126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:11.253126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:11.253126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:11.253126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:11.253126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:11.253126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:11.253126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:11.253126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:11.253126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:11.253126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:11.253126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 207/418] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:11.260455 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832b6a1-fb89-42f1-aed1-c1f0dcefc426 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:11.308324 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934250c-6596-4db8-a1b7-f9ddcbbc21cc None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:11.308631 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934250c-6596-4db8-a1b7-f9ddcbbc21cc None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:11.308784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934250c-6596-4db8-a1b7-f9ddcbbc21cc None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:11.310916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 208/419] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:14:11.320692 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c03d28-ac7a-4b0a-beaf-c7d439f77e59 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:11.320692 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c03d28-ac7a-4b0a-beaf-c7d439f77e59 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:11.320692 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c03d28-ac7a-4b0a-beaf-c7d439f77e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:11.338957 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-77c03d28-ac7a-4b0a-beaf-c7d439f77e59 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:11.340520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-77c03d28-ac7a-4b0a-beaf-c7d439f77e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:11.378204 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832b6a1-fb89-42f1-aed1-c1f0dcefc426 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:11.437389 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:11.440079 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d812d-9cb1-40e9-a6e9-6d0dd590e9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:11.440693 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d812d-9cb1-40e9-a6e9-6d0dd590e9a2 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:11.440977 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d812d-9cb1-40e9-a6e9-6d0dd590e9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:11.441489 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d812d-9cb1-40e9-a6e9-6d0dd590e9a2 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:11.442261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d812d-9cb1-40e9-a6e9-6d0dd590e9a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:11.442570 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d812d-9cb1-40e9-a6e9-6d0dd590e9a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:11.443978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d812d-9cb1-40e9-a6e9-6d0dd590e9a2 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:11.460959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 212/420] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:14:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:11.466691 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d812d-9cb1-40e9-a6e9-6d0dd590e9a2 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:11.487187 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 209/421] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:14:11.558577 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:11.622616 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d812d-9cb1-40e9-a6e9-6d0dd590e9a2 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:11.678762 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf5e17-1943-403b-81d2-bc60cb894771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:11.679419 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf5e17-1943-403b-81d2-bc60cb894771 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:11.679701 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf5e17-1943-403b-81d2-bc60cb894771 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:11.679971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf5e17-1943-403b-81d2-bc60cb894771 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:11.764438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf5e17-1943-403b-81d2-bc60cb894771 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:11.765968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf5e17-1943-403b-81d2-bc60cb894771 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:11.823719 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:11.886235 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 213/422] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:11.891982 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c03d28-ac7a-4b0a-beaf-c7d439f77e59 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:11.919195 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf5e17-1943-403b-81d2-bc60cb894771 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:12.066786 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c03d28-ac7a-4b0a-beaf-c7d439f77e59 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:12.094031 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf5e17-1943-403b-81d2-bc60cb894771 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:12.138250 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82487663-0cc6-48bc-a583-6112fd437308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:12.138883 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82487663-0cc6-48bc-a583-6112fd437308 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:12.139201 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82487663-0cc6-48bc-a583-6112fd437308 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:12.140031 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82487663-0cc6-48bc-a583-6112fd437308 None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:12.141279 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82487663-0cc6-48bc-a583-6112fd437308 None admin] RBAC: Authorizing `identity:get_project(project_id=10ae72b6264047109854b2e9468e9ba3)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:12.142722 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82487663-0cc6-48bc-a583-6112fd437308 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:12.151997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 210/423] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:11 2022] GET /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:12.156245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82487663-0cc6-48bc-a583-6112fd437308 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:12.168878 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169b8d2-e2f9-4949-8dcd-a6f4a2e0dffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:12.169523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169b8d2-e2f9-4949-8dcd-a6f4a2e0dffa None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:12.169807 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169b8d2-e2f9-4949-8dcd-a6f4a2e0dffa None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:12.170082 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169b8d2-e2f9-4949-8dcd-a6f4a2e0dffa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:12.181024 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169b8d2-e2f9-4949-8dcd-a6f4a2e0dffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:12.185800 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-2169b8d2-e2f9-4949-8dcd-a6f4a2e0dffa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:14:12.185800 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:12.185800 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:12.185800 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:12.185800 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:12.185800 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:12.185800 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:12.185800 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:12.185800 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:12.185800 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:12.185800 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:12.185800 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:12.185800 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:12.185800 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:12.185800 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:12.185800 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:12.186708 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:12.186708 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:12.186708 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:12.186708 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:12.186708 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:12.186708 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:12.186708 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:12.186708 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:12.186708 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:12.186708 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:12.186708 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:12.186708 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:12.186708 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:12.186708 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:12.186708 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:12.186708 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:12.187561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:12.187561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:12.187561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:12.187561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:12.187561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:12.187561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:12.187561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:12.187561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:12.187561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:12.187561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:12.187561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:14:12.187561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:12.187561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 214/424] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:14:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:12.195914 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169b8d2-e2f9-4949-8dcd-a6f4a2e0dffa None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:12.215427 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:12.229167 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:12.273971 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82487663-0cc6-48bc-a583-6112fd437308 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:12.311255 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd443697-c736-4965-9e69-6f27be61a81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:12.311885 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd443697-c736-4965-9e69-6f27be61a81d None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:12.312211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd443697-c736-4965-9e69-6f27be61a81d None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:12.312486 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd443697-c736-4965-9e69-6f27be61a81d None admin] PATH_INFO: `/v3/groups/f47970dca072475d935952796585962f` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:12.316047 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd443697-c736-4965-9e69-6f27be61a81d None admin] RBAC: Authorizing `identity:get_group(group_id=f47970dca072475d935952796585962f)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:12.317833 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd443697-c736-4965-9e69-6f27be61a81d None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:12.320335 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 211/425] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 00:14:12 2022] GET /identity/v3/groups/f47970dca072475d935952796585962f => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:12.329374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd443697-c736-4965-9e69-6f27be61a81d None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:12.415113 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169b8d2-e2f9-4949-8dcd-a6f4a2e0dffa None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:12.459449 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f795178-3986-4c81-a8ad-a5ef78ce9950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:12.460051 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f795178-3986-4c81-a8ad-a5ef78ce9950 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:12.460326 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f795178-3986-4c81-a8ad-a5ef78ce9950 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:12.460675 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f795178-3986-4c81-a8ad-a5ef78ce9950 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:12.461336 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f795178-3986-4c81-a8ad-a5ef78ce9950 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:12.461635 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f795178-3986-4c81-a8ad-a5ef78ce9950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:12.463047 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f795178-3986-4c81-a8ad-a5ef78ce9950 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:12.472434 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 215/426] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:12.479580 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2041f6-3eac-455e-b007-7e26c498eed3 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:12.480101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2041f6-3eac-455e-b007-7e26c498eed3 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:12.480696 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2041f6-3eac-455e-b007-7e26c498eed3 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:12.484038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 216/427] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:12.485465 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2041f6-3eac-455e-b007-7e26c498eed3 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:12.492887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd443697-c736-4965-9e69-6f27be61a81d None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:12.506733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:12.547916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5f054-c0ac-458b-ad6b-b4f0d99f4c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:12.549331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5f054-c0ac-458b-ad6b-b4f0d99f4c87 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:12.549819 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5f054-c0ac-458b-ad6b-b4f0d99f4c87 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:12.550699 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5f054-c0ac-458b-ad6b-b4f0d99f4c87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:12.551975 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5f054-c0ac-458b-ad6b-b4f0d99f4c87 None admin] RBAC: Adding query filter params (group.id=f47970dca072475d935952796585962f, role.id=3fe3a1eb546b456aa3c8bce846a8d37f, scope.project.id=10ae72b6264047109854b2e9468e9ba3) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:12.552509 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5f054-c0ac-458b-ad6b-b4f0d99f4c87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:12.554890 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5f054-c0ac-458b-ad6b-b4f0d99f4c87 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:12.563376 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 212/428] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 00:14:12 2022] GET /identity/v3/role_assignments?group.id=f47970dca072475d935952796585962f&scope.project.id=10ae72b6264047109854b2e9468e9ba3&role.id=3fe3a1eb546b456aa3c8bce846a8d37f => generated 611 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:12.565013 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc95b1-b205-4413-908f-f3bc3122901a None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:12.565426 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc95b1-b205-4413-908f-f3bc3122901a None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:12.565829 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc95b1-b205-4413-908f-f3bc3122901a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:12.589403 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-47cc95b1-b205-4413-908f-f3bc3122901a None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:12.591625 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-47cc95b1-b205-4413-908f-f3bc3122901a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:12.605038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:12.663839 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2041f6-3eac-455e-b007-7e26c498eed3 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:12.681825 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 213/429] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:12.729325 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa847aa0-d3cc-4008-bd64-7434ecb071e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:12.729939 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa847aa0-d3cc-4008-bd64-7434ecb071e0 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:12.730215 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa847aa0-d3cc-4008-bd64-7434ecb071e0 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:12.730536 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa847aa0-d3cc-4008-bd64-7434ecb071e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:12.816452 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa847aa0-d3cc-4008-bd64-7434ecb071e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:12.818266 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa847aa0-d3cc-4008-bd64-7434ecb071e0 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:12.898405 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:12.935791 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 217/430] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:12.942030 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc95b1-b205-4413-908f-f3bc3122901a None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:13.083672 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc95b1-b205-4413-908f-f3bc3122901a None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:13.092523 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:13.102204 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa847aa0-d3cc-4008-bd64-7434ecb071e0 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:13.130347 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f0243-ab2b-4017-be6b-8ce00b321716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:13.131011 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f0243-ab2b-4017-be6b-8ce00b321716 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:13.131316 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f0243-ab2b-4017-be6b-8ce00b321716 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:13.131909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f0243-ab2b-4017-be6b-8ce00b321716 None admin] PATH_INFO: `/v3/projects/10ae72b6264047109854b2e9468e9ba3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:13.132833 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f0243-ab2b-4017-be6b-8ce00b321716 None admin] RBAC: Authorizing `identity:get_project(project_id=10ae72b6264047109854b2e9468e9ba3)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:13.134284 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f0243-ab2b-4017-be6b-8ce00b321716 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:13.136504 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 214/431] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:12 2022] GET /identity/v3/projects/10ae72b6264047109854b2e9468e9ba3 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:13.142872 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f0243-ab2b-4017-be6b-8ce00b321716 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:13.222525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa847aa0-d3cc-4008-bd64-7434ecb071e0 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:13.260720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f0243-ab2b-4017-be6b-8ce00b321716 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:13.262678 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d92280-ca59-47c8-b74c-56a364abe4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:13.263693 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d92280-ca59-47c8-b74c-56a364abe4ae None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:13.264175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d92280-ca59-47c8-b74c-56a364abe4ae None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:13.264699 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d92280-ca59-47c8-b74c-56a364abe4ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:13.277359 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d92280-ca59-47c8-b74c-56a364abe4ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:13.283360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-d2d92280-ca59-47c8-b74c-56a364abe4ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:13.283360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:13.283360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:13.283360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:13.283360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:13.283360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:13.283360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:13.283360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:13.283360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:13.283360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:13.283360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:13.283360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:13.283360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:13.283360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:13.283360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:13.283360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:13.284241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:13.284241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:13.284241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:13.284241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:13.284241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:13.284241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:13.284241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:13.284241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:13.284241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:13.284241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:13.284241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:13.284241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:13.284241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:13.284241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:13.284241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:13.284241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:13.285076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:13.285076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:13.285076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:13.285076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:13.285076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:13.285076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:13.285076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:13.285076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:13.285076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:13.285076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:13.285076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 00:14:13.285076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:13.287879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 218/432] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:13.293849 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d92280-ca59-47c8-b74c-56a364abe4ae None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:13.301864 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc8a61-4e23-44c5-8c24-58e7f9c9750b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:13.302598 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc8a61-4e23-44c5-8c24-58e7f9c9750b None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:13.302875 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc8a61-4e23-44c5-8c24-58e7f9c9750b None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:13.303427 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc8a61-4e23-44c5-8c24-58e7f9c9750b None admin] PATH_INFO: `/v3/groups/f47970dca072475d935952796585962f` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:13.304694 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc8a61-4e23-44c5-8c24-58e7f9c9750b None admin] RBAC: Authorizing `identity:get_group(group_id=f47970dca072475d935952796585962f)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:13.306316 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc8a61-4e23-44c5-8c24-58e7f9c9750b None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:13.311118 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 215/433] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 00:14:13 2022] GET /identity/v3/groups/f47970dca072475d935952796585962f => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:13.315110 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc8a61-4e23-44c5-8c24-58e7f9c9750b None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:13.335928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:13.372670 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:13.423701 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d92280-ca59-47c8-b74c-56a364abe4ae None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:13.451761 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc8a61-4e23-44c5-8c24-58e7f9c9750b None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:13.465249 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80a54a-84ef-4785-b7c9-26cccbb726db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:13.468821 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80a54a-84ef-4785-b7c9-26cccbb726db None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:13.468821 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80a54a-84ef-4785-b7c9-26cccbb726db None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:13.468821 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80a54a-84ef-4785-b7c9-26cccbb726db None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:13.468821 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80a54a-84ef-4785-b7c9-26cccbb726db None admin] RBAC: Adding query filter params (name=member) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:13.468821 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80a54a-84ef-4785-b7c9-26cccbb726db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:13.469405 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80a54a-84ef-4785-b7c9-26cccbb726db None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:13.480753 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 219/434] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:14:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:13.482280 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ee7ff-bb9c-424f-ba27-916cc1ac72f4 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:13.482769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ee7ff-bb9c-424f-ba27-916cc1ac72f4 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:13.483835 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ee7ff-bb9c-424f-ba27-916cc1ac72f4 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:13.485343 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 220/435] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:13.490557 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ee7ff-bb9c-424f-ba27-916cc1ac72f4 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:13.496728 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a961b5d-02fe-451b-bd5f-4abe628372b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:13.497635 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a961b5d-02fe-451b-bd5f-4abe628372b1 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:13.498116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a961b5d-02fe-451b-bd5f-4abe628372b1 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:13.498615 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a961b5d-02fe-451b-bd5f-4abe628372b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:13.499628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a961b5d-02fe-451b-bd5f-4abe628372b1 None admin] RBAC: Adding query filter params (group.id=f47970dca072475d935952796585962f, role.id=a7db20dbcb4b458d932c564bc9ad5bfb, scope.project.id=10ae72b6264047109854b2e9468e9ba3) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:13.500143 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a961b5d-02fe-451b-bd5f-4abe628372b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:13.501790 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a961b5d-02fe-451b-bd5f-4abe628372b1 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:13.508696 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 216/436] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 00:14:13 2022] GET /identity/v3/role_assignments?group.id=f47970dca072475d935952796585962f&scope.project.id=10ae72b6264047109854b2e9468e9ba3&role.id=a7db20dbcb4b458d932c564bc9ad5bfb => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:13.510116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7b7cd-781f-47e9-8ab8-f862d6a55610 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:13.510549 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7b7cd-781f-47e9-8ab8-f862d6a55610 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:13.510972 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7b7cd-781f-47e9-8ab8-f862d6a55610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:13.532311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-50e7b7cd-781f-47e9-8ab8-f862d6a55610 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:13.534060 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-50e7b7cd-781f-47e9-8ab8-f862d6a55610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:13.615475 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:13.616669 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 217/437] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:13.622765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ee7ff-bb9c-424f-ba27-916cc1ac72f4 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:13.624535 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47010e-d1aa-46fb-b9de-f7ec75c49fe0 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:13.624982 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47010e-d1aa-46fb-b9de-f7ec75c49fe0 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:13.625439 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47010e-d1aa-46fb-b9de-f7ec75c49fe0 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:13.627380 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 218/438] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:13.633856 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfeef7-6d56-4998-a3a2-920988c0aa95 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:13.634465 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfeef7-6d56-4998-a3a2-920988c0aa95 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:13.634947 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfeef7-6d56-4998-a3a2-920988c0aa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:13.656804 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-13cfeef7-6d56-4998-a3a2-920988c0aa95 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:13.658474 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-13cfeef7-6d56-4998-a3a2-920988c0aa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:13.666268 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a457b-e85f-488b-8720-858e755113ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:13.666884 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a457b-e85f-488b-8720-858e755113ec None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:13.667245 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a457b-e85f-488b-8720-858e755113ec None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:13.667524 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a457b-e85f-488b-8720-858e755113ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:13.697839 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:13.751709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 219/439] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:13.765272 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a457b-e85f-488b-8720-858e755113ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:13.766753 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a457b-e85f-488b-8720-858e755113ec None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:13.871423 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:13.878952 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 221/440] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 00:14:13.884961 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfeef7-6d56-4998-a3a2-920988c0aa95 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:13.964733 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a457b-e85f-488b-8720-858e755113ec None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:14.003603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfeef7-6d56-4998-a3a2-920988c0aa95 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:14.046853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f913c3e-9d1d-4247-b23f-ca1e92ab9bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:14.047561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f913c3e-9d1d-4247-b23f-ca1e92ab9bca None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:14.047844 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f913c3e-9d1d-4247-b23f-ca1e92ab9bca None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:14.048119 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f913c3e-9d1d-4247-b23f-ca1e92ab9bca None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:14.049366 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f913c3e-9d1d-4247-b23f-ca1e92ab9bca None admin] RBAC: Authorizing `identity:get_project(project_id=60965deec4684d2f95fd5e6ebac6f77c)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:14.050699 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f913c3e-9d1d-4247-b23f-ca1e92ab9bca None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:14.052677 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 220/441] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:13 2022] GET /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:14.058005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f913c3e-9d1d-4247-b23f-ca1e92ab9bca None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:14.092080 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a457b-e85f-488b-8720-858e755113ec None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:14.095436 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:14.126984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bfa8a-59c5-4fe6-9e45-951efa6445b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:14.127624 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bfa8a-59c5-4fe6-9e45-951efa6445b2 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:14.127911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bfa8a-59c5-4fe6-9e45-951efa6445b2 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:14.128185 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bfa8a-59c5-4fe6-9e45-951efa6445b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:14.138627 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bfa8a-59c5-4fe6-9e45-951efa6445b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:14.144045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-c65bfa8a-59c5-4fe6-9e45-951efa6445b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:14:14.144045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:14.144045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:14.144045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:14.144045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:14.144045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:14.144045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:14.144045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:14.144045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:14.144045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:14.144045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:14.144045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:14.144045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:14.144045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:14.144045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:14.144045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:14.145097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:14.145097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:14.145097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:14.145097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:14.145097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:14.145097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:14.145097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:14.145097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:14.145097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:14.145097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:14.145097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:14.145097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:14.145097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:14.145097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:14.145097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:14.145097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:14.145917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:14.145917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:14.145917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:14.145917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:14.145917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:14.145917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:14.145917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:14.145917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:14.145917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:14.145917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:14.145917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 00:14:14.145917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:14.145917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 222/442] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:14:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:14.145917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bfa8a-59c5-4fe6-9e45-951efa6445b2 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:14.166579 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f913c3e-9d1d-4247-b23f-ca1e92ab9bca None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:14.200713 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc91179-9f7a-4900-a076-255a512aaedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:14.201332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc91179-9f7a-4900-a076-255a512aaedf None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:14.201602 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc91179-9f7a-4900-a076-255a512aaedf None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:14.202758 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc91179-9f7a-4900-a076-255a512aaedf None admin] PATH_INFO: `/v3/groups/f47970dca072475d935952796585962f` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:14.204143 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc91179-9f7a-4900-a076-255a512aaedf None admin] RBAC: Authorizing `identity:get_group(group_id=f47970dca072475d935952796585962f)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:14.205072 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:14.205625 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc91179-9f7a-4900-a076-255a512aaedf None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:14.207383 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 221/443] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 00:14:14 2022] GET /identity/v3/groups/f47970dca072475d935952796585962f => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:14.212381 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc91179-9f7a-4900-a076-255a512aaedf None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:14.248554 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bfa8a-59c5-4fe6-9e45-951efa6445b2 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:14.284014 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd207f1-632e-4d3f-aea1-a4b42ea4246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:14.284717 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd207f1-632e-4d3f-aea1-a4b42ea4246f None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:14.285007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd207f1-632e-4d3f-aea1-a4b42ea4246f None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:14.285283 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd207f1-632e-4d3f-aea1-a4b42ea4246f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:14.295332 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd207f1-632e-4d3f-aea1-a4b42ea4246f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:14.299972 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-7cd207f1-632e-4d3f-aea1-a4b42ea4246f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:14.299972 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:14.299972 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:14.299972 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:14.299972 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:14.299972 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:14.299972 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:14.299972 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:14.299972 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:14.299972 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:14.299972 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:14.299972 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:14.299972 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:14.299972 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:14.299972 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:14.299972 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:14.300944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:14.300944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:14.300944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:14.300944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:14.300944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:14.300944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:14.300944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:14.300944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:14.300944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:14.300944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:14.300944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:14.300944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:14.300944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:14.300944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:14.300944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:14.300944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:14.301737 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:14.301737 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:14.301737 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:14.301737 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:14.301737 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:14.301737 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:14.301737 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:14.301737 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:14.301737 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:14.301737 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:14.301737 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:14.301737 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:14.301737 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 223/444] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 00:14:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:14.302388 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd207f1-632e-4d3f-aea1-a4b42ea4246f None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:14.313429 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc91179-9f7a-4900-a076-255a512aaedf None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:14.316171 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:14.348521 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2817e2-0c45-4797-984a-a264c416dcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:14.349148 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2817e2-0c45-4797-984a-a264c416dcc7 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:14.349395 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2817e2-0c45-4797-984a-a264c416dcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:14.349663 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2817e2-0c45-4797-984a-a264c416dcc7 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:14.350323 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2817e2-0c45-4797-984a-a264c416dcc7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:14.350621 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2817e2-0c45-4797-984a-a264c416dcc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:14.352021 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2817e2-0c45-4797-984a-a264c416dcc7 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:14.360132 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 222/445] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:14.360901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2817e2-0c45-4797-984a-a264c416dcc7 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:14.404792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd207f1-632e-4d3f-aea1-a4b42ea4246f None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:14.421089 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:14.439728 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc180aa-0419-4ce9-8c06-da3038d8c374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:14.440322 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc180aa-0419-4ce9-8c06-da3038d8c374 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:14.440606 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc180aa-0419-4ce9-8c06-da3038d8c374 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:14.440878 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc180aa-0419-4ce9-8c06-da3038d8c374 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:14.441597 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc180aa-0419-4ce9-8c06-da3038d8c374 None admin] RBAC: Adding query filter params (group.id=f47970dca072475d935952796585962f, role.id=3fe3a1eb546b456aa3c8bce846a8d37f, scope.project.id=60965deec4684d2f95fd5e6ebac6f77c) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:14.441906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc180aa-0419-4ce9-8c06-da3038d8c374 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:14.443411 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc180aa-0419-4ce9-8c06-da3038d8c374 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:14.449092 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 224/446] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 00:14:14 2022] GET /identity/v3/role_assignments?group.id=f47970dca072475d935952796585962f&scope.project.id=60965deec4684d2f95fd5e6ebac6f77c&role.id=3fe3a1eb546b456aa3c8bce846a8d37f => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:14.449866 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc180aa-0419-4ce9-8c06-da3038d8c374 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:14.466962 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2817e2-0c45-4797-984a-a264c416dcc7 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:14.520029 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf507abf-249a-4b7a-8567-4d0941504afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:14.520780 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf507abf-249a-4b7a-8567-4d0941504afd None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:14.521162 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf507abf-249a-4b7a-8567-4d0941504afd None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:14.521518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf507abf-249a-4b7a-8567-4d0941504afd None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:14.522284 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf507abf-249a-4b7a-8567-4d0941504afd None admin] RBAC: Adding query filter params (name=admin) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:14.522664 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf507abf-249a-4b7a-8567-4d0941504afd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:14.524597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf507abf-249a-4b7a-8567-4d0941504afd None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:14.538745 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 223/447] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:14.539911 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf507abf-249a-4b7a-8567-4d0941504afd None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:14.572427 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:14.581880 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc180aa-0419-4ce9-8c06-da3038d8c374 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:14.619414 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ba479-2abf-431d-b39d-b798700f68b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:14.620029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ba479-2abf-431d-b39d-b798700f68b6 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:14.620313 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ba479-2abf-431d-b39d-b798700f68b6 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:14.620593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ba479-2abf-431d-b39d-b798700f68b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:14.657667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf507abf-249a-4b7a-8567-4d0941504afd None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:14.680146 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:14.697300 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78ad33-d239-4464-ab5e-88b1130c16f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:14.698014 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78ad33-d239-4464-ab5e-88b1130c16f1 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:14.698290 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78ad33-d239-4464-ab5e-88b1130c16f1 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:14.698563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78ad33-d239-4464-ab5e-88b1130c16f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:14.713752 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ba479-2abf-431d-b39d-b798700f68b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:14.716019 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ba479-2abf-431d-b39d-b798700f68b6 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:14.782871 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78ad33-d239-4464-ab5e-88b1130c16f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:14.784514 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78ad33-d239-4464-ab5e-88b1130c16f1 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:14.821199 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:14.832834 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 225/448] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:14.838352 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ba479-2abf-431d-b39d-b798700f68b6 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:14.903518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 224/449] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 00:14:14.909549 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78ad33-d239-4464-ab5e-88b1130c16f1 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:14.923454 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:14.943168 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ba479-2abf-431d-b39d-b798700f68b6 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:14.977653 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385df56f-1d42-4f13-a780-79dc80dc5212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:14.979044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df56f-1d42-4f13-a780-79dc80dc5212 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:14.979044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df56f-1d42-4f13-a780-79dc80dc5212 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:14.979044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df56f-1d42-4f13-a780-79dc80dc5212 None admin] PATH_INFO: `/v3/projects/60965deec4684d2f95fd5e6ebac6f77c` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:14.979940 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385df56f-1d42-4f13-a780-79dc80dc5212 None admin] RBAC: Authorizing `identity:get_project(project_id=60965deec4684d2f95fd5e6ebac6f77c)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:14.981397 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385df56f-1d42-4f13-a780-79dc80dc5212 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:14.983101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 226/450] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:14 2022] GET /identity/v3/projects/60965deec4684d2f95fd5e6ebac6f77c => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:14.989155 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385df56f-1d42-4f13-a780-79dc80dc5212 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:15.009594 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78ad33-d239-4464-ab5e-88b1130c16f1 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:15.036793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:15.045945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bba06-d2ef-4819-8fa3-5ba916123e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:15.046561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bba06-d2ef-4819-8fa3-5ba916123e71 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:15.046840 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bba06-d2ef-4819-8fa3-5ba916123e71 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:15.047142 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bba06-d2ef-4819-8fa3-5ba916123e71 None admin] PATH_INFO: `/v3/projects/792d367d504f4db2950fddd56501d7c3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:15.048257 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bba06-d2ef-4819-8fa3-5ba916123e71 None admin] RBAC: Authorizing `identity:get_project(project_id=792d367d504f4db2950fddd56501d7c3)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:15.049703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bba06-d2ef-4819-8fa3-5ba916123e71 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:15.051516 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 225/451] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 00:14:14 2022] GET /identity/v3/projects/792d367d504f4db2950fddd56501d7c3 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:15.056704 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bba06-d2ef-4819-8fa3-5ba916123e71 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:15.089389 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385df56f-1d42-4f13-a780-79dc80dc5212 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:15.124788 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01782831-91b4-4197-9333-53b02a62ec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:15.125401 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01782831-91b4-4197-9333-53b02a62ec6a None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:15.125680 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01782831-91b4-4197-9333-53b02a62ec6a None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:15.125955 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01782831-91b4-4197-9333-53b02a62ec6a None admin] PATH_INFO: `/v3/groups/f47970dca072475d935952796585962f` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:15.127098 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01782831-91b4-4197-9333-53b02a62ec6a None admin] RBAC: Authorizing `identity:get_group(group_id=f47970dca072475d935952796585962f)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:15.128560 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01782831-91b4-4197-9333-53b02a62ec6a None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:15.130175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 227/452] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 00:14:14 2022] GET /identity/v3/groups/f47970dca072475d935952796585962f => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:15.136052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01782831-91b4-4197-9333-53b02a62ec6a None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:15.153694 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:15.158341 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bba06-d2ef-4819-8fa3-5ba916123e71 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:15.193167 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f23f5-149f-4f14-9cad-3e11f70c4e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:15.193790 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f23f5-149f-4f14-9cad-3e11f70c4e92 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:15.194067 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f23f5-149f-4f14-9cad-3e11f70c4e92 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:15.194341 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f23f5-149f-4f14-9cad-3e11f70c4e92 None admin] PATH_INFO: `/v3/groups/1179533c85644cb8a44315ecadb735fc` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:15.195482 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f23f5-149f-4f14-9cad-3e11f70c4e92 None admin] RBAC: Authorizing `identity:get_group(group_id=1179533c85644cb8a44315ecadb735fc)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:15.196935 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f23f5-149f-4f14-9cad-3e11f70c4e92 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:15.198489 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 226/453] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 00:14:15 2022] GET /identity/v3/groups/1179533c85644cb8a44315ecadb735fc => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:15.204276 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f23f5-149f-4f14-9cad-3e11f70c4e92 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:15.237840 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01782831-91b4-4197-9333-53b02a62ec6a None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:15.263482 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:15.271389 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd38a4-1223-4831-b0ce-3c0f0179552d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:15.271977 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd38a4-1223-4831-b0ce-3c0f0179552d None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:15.272253 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd38a4-1223-4831-b0ce-3c0f0179552d None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:15.272527 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd38a4-1223-4831-b0ce-3c0f0179552d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:15.273244 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd38a4-1223-4831-b0ce-3c0f0179552d None admin] RBAC: Adding query filter params (group.id=f47970dca072475d935952796585962f, role.id=a7db20dbcb4b458d932c564bc9ad5bfb, scope.project.id=60965deec4684d2f95fd5e6ebac6f77c) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:15.273551 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd38a4-1223-4831-b0ce-3c0f0179552d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:15.274985 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd38a4-1223-4831-b0ce-3c0f0179552d None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:15.280650 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 228/454] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 00:14:15 2022] GET /identity/v3/role_assignments?group.id=f47970dca072475d935952796585962f&scope.project.id=60965deec4684d2f95fd5e6ebac6f77c&role.id=a7db20dbcb4b458d932c564bc9ad5bfb => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:15.313113 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f23f5-149f-4f14-9cad-3e11f70c4e92 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:15.349641 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36904bc0-1ac8-4c8e-8dba-7e25d86accd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:15.350098 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36904bc0-1ac8-4c8e-8dba-7e25d86accd6 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:15.350376 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36904bc0-1ac8-4c8e-8dba-7e25d86accd6 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:15.350647 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36904bc0-1ac8-4c8e-8dba-7e25d86accd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:15.351422 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36904bc0-1ac8-4c8e-8dba-7e25d86accd6 None admin] RBAC: Adding query filter params (group.id=1179533c85644cb8a44315ecadb735fc, role.id=9b372d4fe82a4a54a3ecd29e7b912586, scope.project.id=792d367d504f4db2950fddd56501d7c3) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:15.351760 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36904bc0-1ac8-4c8e-8dba-7e25d86accd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:15.353225 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36904bc0-1ac8-4c8e-8dba-7e25d86accd6 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:15.360282 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 227/455] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 00:14:15 2022] GET /identity/v3/role_assignments?group.id=1179533c85644cb8a44315ecadb735fc&scope.project.id=792d367d504f4db2950fddd56501d7c3&role.id=9b372d4fe82a4a54a3ecd29e7b912586 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:17.964381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03891d1b-8a4e-4275-b046-3a1777e92b92 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:17.964905 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03891d1b-8a4e-4275-b046-3a1777e92b92 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:17.964905 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03891d1b-8a4e-4275-b046-3a1777e92b92 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:17.966463 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 229/456] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:17.971775 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d8be8-edad-4953-8793-3f34643ebc87 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:17.972165 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d8be8-edad-4953-8793-3f34643ebc87 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:17.972350 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d8be8-edad-4953-8793-3f34643ebc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:17.990781 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-b42d8be8-edad-4953-8793-3f34643ebc87 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:17.992144 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-b42d8be8-edad-4953-8793-3f34643ebc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:18.062513 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 228/457] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:18.102598 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2e3d3-b7e4-415b-a667-79f26698d8a3 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:18.102888 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2e3d3-b7e4-415b-a667-79f26698d8a3 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:18.103189 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2e3d3-b7e4-415b-a667-79f26698d8a3 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:18.104709 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 230/458] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:18.110737 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c4d8e-47e8-4c9f-8db5-e6c86ac412ae None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:18.111273 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c4d8e-47e8-4c9f-8db5-e6c86ac412ae None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:18.111738 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c4d8e-47e8-4c9f-8db5-e6c86ac412ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:18.131770 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-717c4d8e-47e8-4c9f-8db5-e6c86ac412ae None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:18.133291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-717c4d8e-47e8-4c9f-8db5-e6c86ac412ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:18.188425 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:18.208615 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 229/459] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:18.294849 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdfc78-75c2-4e18-b266-9e4c65b40aa2 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:18.295161 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdfc78-75c2-4e18-b266-9e4c65b40aa2 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:18.295472 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdfc78-75c2-4e18-b266-9e4c65b40aa2 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:18.296831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 231/460] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:18.302508 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5be0a5-a00b-4404-be7e-212289d160c5 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:18.303070 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5be0a5-a00b-4404-be7e-212289d160c5 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:18.303544 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5be0a5-a00b-4404-be7e-212289d160c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:18.322000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-ff5be0a5-a00b-4404-be7e-212289d160c5 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:18.323598 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-ff5be0a5-a00b-4404-be7e-212289d160c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:18.397505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 230/461] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:18.417248 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdfc78-75c2-4e18-b266-9e4c65b40aa2 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:18.520670 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:18.541064 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdfc78-75c2-4e18-b266-9e4c65b40aa2 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:18.555994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5be0a5-a00b-4404-be7e-212289d160c5 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:18.586345 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab83e61-8429-47a6-bff3-6e06d1ea6da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:18.587178 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab83e61-8429-47a6-bff3-6e06d1ea6da9 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:18.587456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab83e61-8429-47a6-bff3-6e06d1ea6da9 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:18.587725 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab83e61-8429-47a6-bff3-6e06d1ea6da9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:18.603981 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab83e61-8429-47a6-bff3-6e06d1ea6da9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:18.606170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab83e61-8429-47a6-bff3-6e06d1ea6da9 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:18.622765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-0ab83e61-8429-47a6-bff3-6e06d1ea6da9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:18.622765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:18.622765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:18.622765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:18.622765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:18.622765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:18.622765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:18.622765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:18.622765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:18.622765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:18.622765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:18.622765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:18.622765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:18.622765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:18.622765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:18.622765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:18.624311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:18.624311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:18.624311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:18.624311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:18.624311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:18.624311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:18.624311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:18.624311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:18.624311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:18.624311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:18.624311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:18.624311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:18.624311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:18.624311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:18.624311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:18.624311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:18.624311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:18.625144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:18.625144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:18.625144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:18.625144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 232/462] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:18.625876 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd8e30-a551-41d8-babd-b3dfacabf4ee None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:18.625975 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd8e30-a551-41d8-babd-b3dfacabf4ee None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:18.626193 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd8e30-a551-41d8-babd-b3dfacabf4ee None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:18.627764 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 233/463] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:18.630353 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd8e30-a551-41d8-babd-b3dfacabf4ee None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:18.671390 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5be0a5-a00b-4404-be7e-212289d160c5 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:18.691908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:18.711475 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac34d1-3f7a-4ca9-ad6a-f7cfe0ce85d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:18.712219 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac34d1-3f7a-4ca9-ad6a-f7cfe0ce85d6 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:18.712496 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac34d1-3f7a-4ca9-ad6a-f7cfe0ce85d6 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:18.712761 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac34d1-3f7a-4ca9-ad6a-f7cfe0ce85d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:18.723680 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac34d1-3f7a-4ca9-ad6a-f7cfe0ce85d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:18.725045 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac34d1-3f7a-4ca9-ad6a-f7cfe0ce85d6 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:18.740227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-c8ac34d1-3f7a-4ca9-ad6a-f7cfe0ce85d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:18.740227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:18.740227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:18.740227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:18.740227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:18.740227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:18.740227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:18.740227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:18.740227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:18.740227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:18.740227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:18.740227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:18.740227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:18.740227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:18.740227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:18.740227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:18.741378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:18.741378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:18.741378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:18.741378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:18.741378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:18.741378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:18.741378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:18.741378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:18.741378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:18.741378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:18.741378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:18.741378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:18.741378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:18.741378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:18.741378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:18.741378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:18.741378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:18.742438 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:18.742438 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:18.742438 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:18.742438 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 231/464] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:18.743437 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd8e30-a551-41d8-babd-b3dfacabf4ee None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:18.747331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec437ba-82bd-4cf7-aab7-ba2ca8f4e798 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:18.747532 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec437ba-82bd-4cf7-aab7-ba2ca8f4e798 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:18.747801 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec437ba-82bd-4cf7-aab7-ba2ca8f4e798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:18.766571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-7ec437ba-82bd-4cf7-aab7-ba2ca8f4e798 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:18.767797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-7ec437ba-82bd-4cf7-aab7-ba2ca8f4e798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:18.774767 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:18.780647 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb13f9-a2e6-44e4-a176-7c8fbd1d2967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:18.781251 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb13f9-a2e6-44e4-a176-7c8fbd1d2967 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:18.781528 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb13f9-a2e6-44e4-a176-7c8fbd1d2967 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:18.781808 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb13f9-a2e6-44e4-a176-7c8fbd1d2967 None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:18.782443 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb13f9-a2e6-44e4-a176-7c8fbd1d2967 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:18.782744 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb13f9-a2e6-44e4-a176-7c8fbd1d2967 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:18.784177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb13f9-a2e6-44e4-a176-7c8fbd1d2967 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:18.801549 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 234/465] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:18.801549 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb13f9-a2e6-44e4-a176-7c8fbd1d2967 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:18.842232 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 232/466] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:18.842852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec437ba-82bd-4cf7-aab7-ba2ca8f4e798 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:18.912023 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb13f9-a2e6-44e4-a176-7c8fbd1d2967 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:18.943942 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:18.947483 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec437ba-82bd-4cf7-aab7-ba2ca8f4e798 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:18.949904 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266af069-a95a-4395-9274-043f0a429acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:18.950790 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266af069-a95a-4395-9274-043f0a429acf None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:18.950790 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266af069-a95a-4395-9274-043f0a429acf None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:18.951087 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266af069-a95a-4395-9274-043f0a429acf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:18.961883 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266af069-a95a-4395-9274-043f0a429acf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:18.963365 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266af069-a95a-4395-9274-043f0a429acf None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:18.979175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-266af069-a95a-4395-9274-043f0a429acf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:18.979175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:18.979175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:18.979175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:18.979175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:18.979175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:18.979175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:18.979175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:18.979175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:18.979175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:18.979175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:18.979175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:18.979175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:18.979175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:18.979175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:18.979175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:18.980585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:18.980585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:18.980585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:18.980585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:18.980585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:18.980585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:18.980585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:18.980585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:18.980585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:18.980585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:18.980585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:18.980585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:18.980585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:18.980585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:18.980585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:18.980585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:18.980585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:18.981671 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:18.981671 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:18.981671 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:18.983582 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 235/467] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:18.988422 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa68722-3487-4ba2-b621-b98745b7c9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:18.988422 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa68722-3487-4ba2-b621-b98745b7c9ef None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:18.988422 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa68722-3487-4ba2-b621-b98745b7c9ef None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:18.988422 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa68722-3487-4ba2-b621-b98745b7c9ef None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:18.989047 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa68722-3487-4ba2-b621-b98745b7c9ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:18.989047 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa68722-3487-4ba2-b621-b98745b7c9ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:18.990052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266af069-a95a-4395-9274-043f0a429acf None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:18.990403 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa68722-3487-4ba2-b621-b98745b7c9ef None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:19.007111 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 233/468] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:19.007111 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa68722-3487-4ba2-b621-b98745b7c9ef None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:19.044609 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:19.107366 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266af069-a95a-4395-9274-043f0a429acf None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:19.110769 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa68722-3487-4ba2-b621-b98745b7c9ef None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:19.145228 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc1e3e-999f-4bce-a2c3-ce536fce1ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:19.145823 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc1e3e-999f-4bce-a2c3-ce536fce1ba4 None admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:19.146366 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc1e3e-999f-4bce-a2c3-ce536fce1ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:19.146366 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc1e3e-999f-4bce-a2c3-ce536fce1ba4 None admin] PATH_INFO: `/v3/users` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:19.147012 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a57c8-9e85-42bf-a9d5-ca35a861287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:19.147137 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc1e3e-999f-4bce-a2c3-ce536fce1ba4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:19.147627 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a57c8-9e85-42bf-a9d5-ca35a861287d None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:19.147902 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a57c8-9e85-42bf-a9d5-ca35a861287d None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:19.148172 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a57c8-9e85-42bf-a9d5-ca35a861287d None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:19.148481 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc1e3e-999f-4bce-a2c3-ce536fce1ba4 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:19.148801 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a57c8-9e85-42bf-a9d5-ca35a861287d None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:19.149099 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a57c8-9e85-42bf-a9d5-ca35a861287d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:19.150451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a57c8-9e85-42bf-a9d5-ca35a861287d None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:19.163827 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 234/469] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:19.168531 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a57c8-9e85-42bf-a9d5-ca35a861287d None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:19.176309 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 236/470] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 00:14:18 2022] POST /identity/v3/users => generated 246 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:14:19.177373 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc1e3e-999f-4bce-a2c3-ce536fce1ba4 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:19.192190 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:19.283358 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a57c8-9e85-42bf-a9d5-ca35a861287d None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:19.304173 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:19.308057 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc1e3e-999f-4bce-a2c3-ce536fce1ba4 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:19.325269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3b8fb-3f82-4286-bb93-a59a06c96b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:19.325893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3b8fb-3f82-4286-bb93-a59a06c96b44 None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:19.326170 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3b8fb-3f82-4286-bb93-a59a06c96b44 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:19.326577 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3b8fb-3f82-4286-bb93-a59a06c96b44 None admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:19.327277 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3b8fb-3f82-4286-bb93-a59a06c96b44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:19.328775 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3b8fb-3f82-4286-bb93-a59a06c96b44 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:19.352252 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f2019-d185-4bda-a16a-c28cb3c30f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:19.353036 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f2019-d185-4bda-a16a-c28cb3c30f33 None admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:19.353322 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f2019-d185-4bda-a16a-c28cb3c30f33 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:19.353597 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f2019-d185-4bda-a16a-c28cb3c30f33 None admin] PATH_INFO: `/v3/users` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:19.354395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f2019-d185-4bda-a16a-c28cb3c30f33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:19.355941 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f2019-d185-4bda-a16a-c28cb3c30f33 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:19.360053 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 235/471] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 00:14:19 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:14:19.361163 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3b8fb-3f82-4286-bb93-a59a06c96b44 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:19.384870 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 237/472] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 00:14:19 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:14:19.476923 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:19.511047 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3b8fb-3f82-4286-bb93-a59a06c96b44 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:19.560980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb393ec8-39bc-4526-a472-71efdd70ae79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:19.561669 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb393ec8-39bc-4526-a472-71efdd70ae79 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:19.561945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb393ec8-39bc-4526-a472-71efdd70ae79 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:19.562217 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb393ec8-39bc-4526-a472-71efdd70ae79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:19.577101 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb393ec8-39bc-4526-a472-71efdd70ae79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:19.578967 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb393ec8-39bc-4526-a472-71efdd70ae79 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:19.596068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-fb393ec8-39bc-4526-a472-71efdd70ae79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:19.596068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:19.596068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:19.596068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:19.596068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:19.596068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:19.596068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:19.596068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:19.596068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:19.596068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:19.596068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:19.596068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:19.596068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:19.596068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:19.596068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:19.596068 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:19.597015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:19.597015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:19.597015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:19.597015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:19.597015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:19.597015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:19.597015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:19.597015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:19.597015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:19.597015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:19.597015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:19.597015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:19.597015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:19.597015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:19.597015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:19.597015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:19.597015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:19.597875 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:19.597875 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:19.597875 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:19.599601 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 236/473] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:19.605360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f2019-d185-4bda-a16a-c28cb3c30f33 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:19.726899 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f2019-d185-4bda-a16a-c28cb3c30f33 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:19.763554 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd0973-2734-4594-91e4-c241dad5d0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:19.765151 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd0973-2734-4594-91e4-c241dad5d0f7 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:19.765880 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd0973-2734-4594-91e4-c241dad5d0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:19.766151 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd0973-2734-4594-91e4-c241dad5d0f7 None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:19.766796 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd0973-2734-4594-91e4-c241dad5d0f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:19.767122 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd0973-2734-4594-91e4-c241dad5d0f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:19.768571 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd0973-2734-4594-91e4-c241dad5d0f7 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:19.782213 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 238/474] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:19.787433 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb393ec8-39bc-4526-a472-71efdd70ae79 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:19.901104 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb393ec8-39bc-4526-a472-71efdd70ae79 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:19.928641 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:19.938316 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73643c0b-c57c-47c5-969b-5962ea53e0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:19.939261 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73643c0b-c57c-47c5-969b-5962ea53e0ba None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:19.939551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73643c0b-c57c-47c5-969b-5962ea53e0ba None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:19.939826 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73643c0b-c57c-47c5-969b-5962ea53e0ba None admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:19.940486 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73643c0b-c57c-47c5-969b-5962ea53e0ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:19.941959 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73643c0b-c57c-47c5-969b-5962ea53e0ba None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:19.967173 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 237/475] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 00:14:19 2022] POST /identity/v3/users => generated 249 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:14:21.638384 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92de73-6057-44f9-a3d4-dd0a363ed8c4 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:21.639532 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92de73-6057-44f9-a3d4-dd0a363ed8c4 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:21.639814 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92de73-6057-44f9-a3d4-dd0a363ed8c4 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:21.641457 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 239/476] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:21.646907 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3eb213-e762-4511-a05c-80bc2b949eb5 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:21.647801 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3eb213-e762-4511-a05c-80bc2b949eb5 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:21.648308 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3eb213-e762-4511-a05c-80bc2b949eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:21.667110 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-2b3eb213-e762-4511-a05c-80bc2b949eb5 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:21.668729 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-2b3eb213-e762-4511-a05c-80bc2b949eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:21.707834 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f97eb-d5e8-4ba3-a631-223f0db135df None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:21.707834 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f97eb-d5e8-4ba3-a631-223f0db135df None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:21.707834 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f97eb-d5e8-4ba3-a631-223f0db135df None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:21.709532 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 240/477] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:21.715132 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632c801-c9a6-492e-bd63-37eea1cb1bf2 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:21.715419 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632c801-c9a6-492e-bd63-37eea1cb1bf2 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:21.715698 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632c801-c9a6-492e-bd63-37eea1cb1bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:21.739884 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-7632c801-c9a6-492e-bd63-37eea1cb1bf2 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:21.741099 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-7632c801-c9a6-492e-bd63-37eea1cb1bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:21.743182 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 238/478] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:21.753328 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:21.788302 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffec6c-24c5-490e-a58b-5fde2ff13f36 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:21.788489 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffec6c-24c5-490e-a58b-5fde2ff13f36 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:21.788763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffec6c-24c5-490e-a58b-5fde2ff13f36 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:21.790277 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 239/479] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:14:21.795993 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ba926-6f27-459e-8b91-9aff0376ba64 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:21.796280 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ba926-6f27-459e-8b91-9aff0376ba64 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:21.796657 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ba926-6f27-459e-8b91-9aff0376ba64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:21.815504 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-830ba926-6f27-459e-8b91-9aff0376ba64 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:21.816703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-830ba926-6f27-459e-8b91-9aff0376ba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:21.825653 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 241/480] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:21.891235 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 240/481] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:14:22.087979 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632c801-c9a6-492e-bd63-37eea1cb1bf2 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:22.155524 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ba926-6f27-459e-8b91-9aff0376ba64 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:22.199951 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632c801-c9a6-492e-bd63-37eea1cb1bf2 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:22.210163 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:22.249082 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76a51b-f59c-4585-8771-c5ffe9a097fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:22.250601 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76a51b-f59c-4585-8771-c5ffe9a097fe None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:22.250891 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76a51b-f59c-4585-8771-c5ffe9a097fe None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:22.251197 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76a51b-f59c-4585-8771-c5ffe9a097fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:22.263379 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76a51b-f59c-4585-8771-c5ffe9a097fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:22.269028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-6c76a51b-f59c-4585-8771-c5ffe9a097fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:22.269028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:22.269028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:22.269028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:22.269028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:22.269028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:22.269028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:22.269028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:22.269028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:22.269028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:22.269028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:22.269028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:22.269028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:22.269028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:22.269028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:22.269028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:22.270101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:22.270101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:22.270101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:22.270101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:22.270101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:22.270101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:22.270101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:22.270101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:22.270101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:22.270101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:22.270101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:22.270101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:22.270101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:22.270101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:22.270101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:22.270101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:22.270898 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:22.270898 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:22.270898 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:22.270898 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:22.270898 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:22.270898 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:22.270898 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:22.270898 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:22.270898 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:22.270898 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:22.270898 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:22.270898 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:22.270898 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 242/482] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 00:14:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:22.271592 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916fc89-2f0a-494b-95bb-d92ba4284adc None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:22.271658 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916fc89-2f0a-494b-95bb-d92ba4284adc None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:22.272032 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916fc89-2f0a-494b-95bb-d92ba4284adc None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:22.273244 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 243/483] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:22.275750 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916fc89-2f0a-494b-95bb-d92ba4284adc None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:22.286146 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:22.292427 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ba926-6f27-459e-8b91-9aff0376ba64 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:22.327284 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcad8db-1265-4e76-ad6f-93a10c29d986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:22.327900 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcad8db-1265-4e76-ad6f-93a10c29d986 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:22.328180 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcad8db-1265-4e76-ad6f-93a10c29d986 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:22.328450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcad8db-1265-4e76-ad6f-93a10c29d986 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:22.338900 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcad8db-1265-4e76-ad6f-93a10c29d986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:22.344116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-ebcad8db-1265-4e76-ad6f-93a10c29d986 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:22.344116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:22.344116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:22.344116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:22.344116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:22.344116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:22.344116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:22.344116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:22.344116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:22.344116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:22.344116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:22.344116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:22.344116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:22.344116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:22.344116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:22.344116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:22.345000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:22.345000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:22.345000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:22.345000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:22.345000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:22.345000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:22.345000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:22.345000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:22.345000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:22.345000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:22.345000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:22.345000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:22.345000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:22.345000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:22.345000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:22.345000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:22.345805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:22.345805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:22.345805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:22.345805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:22.345805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:22.345805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:22.345805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:22.345805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:22.345805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:22.345805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:22.345805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:22.345805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:22.345805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 241/484] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 00:14:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:22.346476 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcad8db-1265-4e76-ad6f-93a10c29d986 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:22.381668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916fc89-2f0a-494b-95bb-d92ba4284adc None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:22.418066 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2708b9b-09e1-4da9-92c5-42e124edbef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:22.418688 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2708b9b-09e1-4da9-92c5-42e124edbef6 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:22.418969 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2708b9b-09e1-4da9-92c5-42e124edbef6 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:22.419266 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2708b9b-09e1-4da9-92c5-42e124edbef6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:22.430163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2708b9b-09e1-4da9-92c5-42e124edbef6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:22.434987 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-d2708b9b-09e1-4da9-92c5-42e124edbef6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:22.434987 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:22.434987 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:22.434987 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:22.434987 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:22.434987 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:22.434987 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:22.434987 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:22.434987 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:22.434987 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:22.434987 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:22.434987 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:22.434987 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:22.434987 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:22.434987 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:22.434987 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:22.436044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:22.436044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:22.436044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:22.436044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:22.436044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:22.436044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:22.436044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:22.436044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:22.436044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:22.436044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:22.436044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:22.436044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:22.436044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:22.436044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:22.436044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:22.436044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:22.436831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:22.436831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:22.436831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:22.436831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:22.436831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:22.436831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:22.436831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:22.436831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:22.436831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:22.436831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:22.436831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:22.436831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:22.436831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 244/485] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 00:14:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:22.437497 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce4224-4a69-477f-a24c-4739ca6655b0 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:22.437563 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce4224-4a69-477f-a24c-4739ca6655b0 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:22.437788 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce4224-4a69-477f-a24c-4739ca6655b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:22.448239 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcad8db-1265-4e76-ad6f-93a10c29d986 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:22.449888 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:22.456177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-42ce4224-4a69-477f-a24c-4739ca6655b0 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:22.457381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-42ce4224-4a69-477f-a24c-4739ca6655b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:22.484554 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8f943-61f6-4284-8b97-39f2f170a0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:22.485142 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8f943-61f6-4284-8b97-39f2f170a0f5 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:22.485416 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8f943-61f6-4284-8b97-39f2f170a0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:22.485685 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8f943-61f6-4284-8b97-39f2f170a0f5 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:22.486329 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8f943-61f6-4284-8b97-39f2f170a0f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:22.486630 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8f943-61f6-4284-8b97-39f2f170a0f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:22.488312 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8f943-61f6-4284-8b97-39f2f170a0f5 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:22.496324 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 242/486] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 00:14:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:22.497131 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8f943-61f6-4284-8b97-39f2f170a0f5 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:22.521832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:22.530851 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 245/487] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:22.531779 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce4224-4a69-477f-a24c-4739ca6655b0 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:22.621784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8f943-61f6-4284-8b97-39f2f170a0f5 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:22.639986 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce4224-4a69-477f-a24c-4739ca6655b0 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:22.656462 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ed3e9-ebc1-40f0-945e-3956d42cc3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:22.657062 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ed3e9-ebc1-40f0-945e-3956d42cc3f9 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:22.657343 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ed3e9-ebc1-40f0-945e-3956d42cc3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:22.657616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ed3e9-ebc1-40f0-945e-3956d42cc3f9 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:22.658300 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ed3e9-ebc1-40f0-945e-3956d42cc3f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:22.658579 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ed3e9-ebc1-40f0-945e-3956d42cc3f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:22.660022 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ed3e9-ebc1-40f0-945e-3956d42cc3f9 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:22.668049 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 243/488] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 00:14:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:22.668675 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ed3e9-ebc1-40f0-945e-3956d42cc3f9 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:22.684071 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ce63a-ce88-4104-b3ac-6ec3b02f3fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:22.684671 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ce63a-ce88-4104-b3ac-6ec3b02f3fb5 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:22.684948 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ce63a-ce88-4104-b3ac-6ec3b02f3fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:22.685218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ce63a-ce88-4104-b3ac-6ec3b02f3fb5 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:22.686453 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ce63a-ce88-4104-b3ac-6ec3b02f3fb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:22.686758 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ce63a-ce88-4104-b3ac-6ec3b02f3fb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:22.688189 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ce63a-ce88-4104-b3ac-6ec3b02f3fb5 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:22.696946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 246/489] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 00:14:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:22.697729 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ce63a-ce88-4104-b3ac-6ec3b02f3fb5 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:22.705597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:22.767340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:22.792162 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ed3e9-ebc1-40f0-945e-3956d42cc3f9 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:22.812380 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ce63a-ce88-4104-b3ac-6ec3b02f3fb5 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:22.828322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ea293-7ecb-4f82-b50b-80ee151abf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:22.828996 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ea293-7ecb-4f82-b50b-80ee151abf71 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:22.829277 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ea293-7ecb-4f82-b50b-80ee151abf71 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:22.829544 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ea293-7ecb-4f82-b50b-80ee151abf71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:22.840688 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ea293-7ecb-4f82-b50b-80ee151abf71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:22.842701 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ea293-7ecb-4f82-b50b-80ee151abf71 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:22.851600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb099bc-2a82-455f-bb51-267b5f9fe8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:22.852367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb099bc-2a82-455f-bb51-267b5f9fe8b1 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:22.852646 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb099bc-2a82-455f-bb51-267b5f9fe8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:22.852918 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb099bc-2a82-455f-bb51-267b5f9fe8b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:22.857090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-f68ea293-7ecb-4f82-b50b-80ee151abf71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:22.857090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:22.857090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:22.857090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:22.857090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:22.857090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:22.857090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:22.857090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:22.857090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:22.857090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:22.857090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:22.857090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:22.857090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:22.857090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:22.857090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:22.857090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:22.857997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:22.857997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:22.857997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:22.857997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:22.857997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:22.857997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:22.857997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:22.857997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:22.857997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:22.857997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:22.857997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:22.857997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:22.857997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:22.857997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:22.857997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:22.857997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:22.857997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:22.858865 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:22.858865 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:22.858865 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:22.858865 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 244/490] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:22.858865 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ea293-7ecb-4f82-b50b-80ee151abf71 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:22.864145 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb099bc-2a82-455f-bb51-267b5f9fe8b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:22.865591 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb099bc-2a82-455f-bb51-267b5f9fe8b1 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:22.880587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-efb099bc-2a82-455f-bb51-267b5f9fe8b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:22.880587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:22.880587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:22.880587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:22.880587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:22.880587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:22.880587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:22.880587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:22.880587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:22.880587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:22.880587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:22.880587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:22.880587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:22.880587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:22.880587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:22.880587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:22.881515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:22.881515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:22.881515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:22.881515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:22.881515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:22.881515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:22.881515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:22.881515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:22.881515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:22.881515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:22.881515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:22.881515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:22.881515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:22.881515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:22.881515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:22.881515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:22.881515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:22.882372 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:22.882372 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:22.882372 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:22.882372 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 247/491] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:22.883192 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb099bc-2a82-455f-bb51-267b5f9fe8b1 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:22.942336 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:22.964580 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ea293-7ecb-4f82-b50b-80ee151abf71 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:22.983633 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb099bc-2a82-455f-bb51-267b5f9fe8b1 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:22.994185 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:23.000267 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23255729-dd7e-42e1-9232-9ea0c6c0621f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:23.000888 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23255729-dd7e-42e1-9232-9ea0c6c0621f None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:23.001170 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23255729-dd7e-42e1-9232-9ea0c6c0621f None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:23.001436 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23255729-dd7e-42e1-9232-9ea0c6c0621f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:23.011824 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23255729-dd7e-42e1-9232-9ea0c6c0621f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:23.013274 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23255729-dd7e-42e1-9232-9ea0c6c0621f None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:23.019602 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2fc96-3b14-41b8-9bd3-c5d3f8a31f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:23.020223 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2fc96-3b14-41b8-9bd3-c5d3f8a31f46 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:23.020505 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2fc96-3b14-41b8-9bd3-c5d3f8a31f46 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:23.020779 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2fc96-3b14-41b8-9bd3-c5d3f8a31f46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:23.027571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-23255729-dd7e-42e1-9232-9ea0c6c0621f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:23.027571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:23.027571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:23.027571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:23.027571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:23.027571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:23.027571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:23.027571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:23.027571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:23.027571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:23.027571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:23.027571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:23.027571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:23.027571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:23.027571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:23.027571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:23.028603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:23.028603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:23.028603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:23.028603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:23.028603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:23.028603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:23.028603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:23.028603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:23.028603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:23.028603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:23.028603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:23.028603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:23.028603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:23.028603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:23.028603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:23.028603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:23.028603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:23.029471 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:23.029471 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:23.029471 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:23.029471 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 245/492] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:23.029471 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23255729-dd7e-42e1-9232-9ea0c6c0621f None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:23.033050 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2fc96-3b14-41b8-9bd3-c5d3f8a31f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:23.038177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-1ae2fc96-3b14-41b8-9bd3-c5d3f8a31f46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:23.038177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:23.038177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:23.038177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:23.038177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:23.038177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:23.038177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:23.038177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:23.038177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:23.038177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:23.038177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:23.038177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:23.038177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:23.038177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:23.038177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:23.038177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:23.039147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:23.039147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:23.039147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:23.039147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:23.039147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:23.039147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:23.039147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:23.039147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:23.039147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:23.039147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:23.039147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:23.039147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:23.039147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:23.039147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:23.039147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:23.039147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:23.040007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:23.040007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:23.040007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:23.040007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:23.040007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:23.040007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:23.040007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:23.040007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:23.040007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:23.040007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:23.040007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:23.040007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:23.040007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 248/493] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 00:14:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:23.040664 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2fc96-3b14-41b8-9bd3-c5d3f8a31f46 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:23.132459 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23255729-dd7e-42e1-9232-9ea0c6c0621f None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:23.150054 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2fc96-3b14-41b8-9bd3-c5d3f8a31f46 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:23.162124 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:23.168628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4402d-cd8e-431c-b168-e1255a33b193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:23.169230 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4402d-cd8e-431c-b168-e1255a33b193 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:23.169513 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4402d-cd8e-431c-b168-e1255a33b193 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:23.169803 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4402d-cd8e-431c-b168-e1255a33b193 None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:23.170445 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4402d-cd8e-431c-b168-e1255a33b193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:23.170750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4402d-cd8e-431c-b168-e1255a33b193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:23.172169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4402d-cd8e-431c-b168-e1255a33b193 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:23.183748 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dc405-4da5-46d3-aea1-fe4b1eb6d0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:23.183933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 246/494] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:23.184642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dc405-4da5-46d3-aea1-fe4b1eb6d0bb None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:23.184926 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dc405-4da5-46d3-aea1-fe4b1eb6d0bb None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:23.185198 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dc405-4da5-46d3-aea1-fe4b1eb6d0bb None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:23.186341 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dc405-4da5-46d3-aea1-fe4b1eb6d0bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:23.186644 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dc405-4da5-46d3-aea1-fe4b1eb6d0bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:23.188060 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dc405-4da5-46d3-aea1-fe4b1eb6d0bb None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:23.189916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4402d-cd8e-431c-b168-e1255a33b193 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:23.200101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 249/495] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:23.200980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dc405-4da5-46d3-aea1-fe4b1eb6d0bb None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:23.231211 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:23.293728 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4402d-cd8e-431c-b168-e1255a33b193 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:23.302186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dc405-4da5-46d3-aea1-fe4b1eb6d0bb None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:23.328689 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90876d82-2f19-44ef-a50b-8bb0af0cbae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:23.329291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90876d82-2f19-44ef-a50b-8bb0af0cbae8 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:23.329575 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90876d82-2f19-44ef-a50b-8bb0af0cbae8 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:23.329847 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90876d82-2f19-44ef-a50b-8bb0af0cbae8 None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:23.330487 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90876d82-2f19-44ef-a50b-8bb0af0cbae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:23.330792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90876d82-2f19-44ef-a50b-8bb0af0cbae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:23.332208 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90876d82-2f19-44ef-a50b-8bb0af0cbae8 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:23.336902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc225e-0f5c-466a-b97c-63b749bdb1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:23.337504 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc225e-0f5c-466a-b97c-63b749bdb1fe None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:23.337783 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc225e-0f5c-466a-b97c-63b749bdb1fe None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:23.338053 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc225e-0f5c-466a-b97c-63b749bdb1fe None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:23.338711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc225e-0f5c-466a-b97c-63b749bdb1fe None admin] RBAC: Adding query filter params (name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:23.339030 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc225e-0f5c-466a-b97c-63b749bdb1fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:23.340423 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc225e-0f5c-466a-b97c-63b749bdb1fe None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:23.343376 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 247/496] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:23.344179 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90876d82-2f19-44ef-a50b-8bb0af0cbae8 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:23.351095 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 250/497] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 00:14:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:23.351916 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc225e-0f5c-466a-b97c-63b749bdb1fe None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:23.401318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:23.445981 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:23.452435 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90876d82-2f19-44ef-a50b-8bb0af0cbae8 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:23.455843 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc225e-0f5c-466a-b97c-63b749bdb1fe None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:23.485768 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87779e-09bb-4ed8-ba36-eef303894c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:23.486401 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87779e-09bb-4ed8-ba36-eef303894c9c None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:23.486671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87779e-09bb-4ed8-ba36-eef303894c9c None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:23.486945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87779e-09bb-4ed8-ba36-eef303894c9c None admin] PATH_INFO: `/v3/users/nova` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:23.488625 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a36f6-6712-4489-bce9-1fcef4be6c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:23.489258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a36f6-6712-4489-bce9-1fcef4be6c15 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:23.489538 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a36f6-6712-4489-bce9-1fcef4be6c15 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:23.489819 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a36f6-6712-4489-bce9-1fcef4be6c15 None admin] PATH_INFO: `/v3/users/glance` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:23.494683 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87779e-09bb-4ed8-ba36-eef303894c9c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:23.496163 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87779e-09bb-4ed8-ba36-eef303894c9c None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:23.497273 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a36f6-6712-4489-bce9-1fcef4be6c15 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:23.499305 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a36f6-6712-4489-bce9-1fcef4be6c15 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:23.509032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-3a87779e-09bb-4ed8-ba36-eef303894c9c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:14:23.509032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:23.509032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:23.509032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:23.509032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:23.509032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:23.509032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:23.509032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:23.509032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:23.509032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:23.509032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:23.509032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:23.509032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:14:23.509032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:14:23.509032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:14:23.509032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:14:23.509930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:23.509930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:23.509930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:14:23.509930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:23.509930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:14:23.509930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:23.509930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:23.509930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:23.509930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:23.509930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:23.509930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:23.509930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:23.509930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:23.509930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:23.509930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:23.509930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:23.509930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:23.509930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:23.510823 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:23.510823 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:23.510823 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:14:23.510823 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:14:23.510823 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:14:23.510823 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:14:23.510823 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:14:23.510823 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:14:23.510823 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:14:23.510823 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:23.510823 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 248/498] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 24 00:14:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:23.511506 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87779e-09bb-4ed8-ba36-eef303894c9c None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:23.512038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-943a36f6-6712-4489-bce9-1fcef4be6c15 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 00:14:23.512038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:23.512038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:23.512038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:23.512038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:23.512038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:23.512038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:23.512038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:23.512038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:23.512038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:23.512038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:23.512038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:23.512038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:14:23.512038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:14:23.512038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:14:23.512038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:14:23.512879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:23.512879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:23.512879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:14:23.512879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:23.512879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:14:23.512879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:23.512879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:23.512879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:23.512879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:23.512879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:23.512879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:23.512879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:23.512879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:23.512879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:23.512879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:23.512879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:23.512879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:23.512879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:23.513765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:23.513765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:23.513765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:14:23.513765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:14:23.513765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:14:23.513765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:14:23.513765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:14:23.513765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:14:23.513765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 00:14:23.513765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:23.514888 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 251/499] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:23.515941 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a36f6-6712-4489-bce9-1fcef4be6c15 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:23.617671 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a36f6-6712-4489-bce9-1fcef4be6c15 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:23.618116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87779e-09bb-4ed8-ba36-eef303894c9c None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:23.628963 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:23.652497 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a64ed-b819-44c1-a1e9-e9ec8a78e03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:23.653043 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a64ed-b819-44c1-a1e9-e9ec8a78e03c None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:23.653155 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b871e1f-8554-4017-abfd-40aab988f2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:23.653599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a64ed-b819-44c1-a1e9-e9ec8a78e03c None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:23.653599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a64ed-b819-44c1-a1e9-e9ec8a78e03c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:23.653757 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b871e1f-8554-4017-abfd-40aab988f2a4 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:23.654009 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b871e1f-8554-4017-abfd-40aab988f2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:23.654286 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b871e1f-8554-4017-abfd-40aab988f2a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:23.661169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a64ed-b819-44c1-a1e9-e9ec8a78e03c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:23.662627 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a64ed-b819-44c1-a1e9-e9ec8a78e03c None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:23.666546 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b871e1f-8554-4017-abfd-40aab988f2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:23.668056 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b871e1f-8554-4017-abfd-40aab988f2a4 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:23.674450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-e16a64ed-b819-44c1-a1e9-e9ec8a78e03c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 00:14:23.674450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:23.674450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:23.674450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:23.674450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:23.674450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:23.674450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:23.674450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:23.674450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:23.674450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:23.674450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:23.674450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:23.674450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:14:23.674450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:14:23.674450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:14:23.674450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:14:23.675355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:23.675355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:23.675355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:14:23.675355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:23.675355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:14:23.675355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:23.675355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:23.675355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:23.675355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:23.675355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:23.675355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:23.675355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:23.675355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:23.675355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:23.675355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:23.675355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:23.675355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:23.675355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:23.676270 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:23.676270 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:23.676270 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:14:23.676270 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:14:23.676270 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:14:23.676270 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:14:23.676270 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:14:23.676270 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:14:23.676270 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 00:14:23.676270 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:23.676270 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 249/500] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:23.676270 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a64ed-b819-44c1-a1e9-e9ec8a78e03c None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:23.685241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-2b871e1f-8554-4017-abfd-40aab988f2a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:23.685241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:23.685241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:23.685241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:23.685241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:23.685241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:23.685241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:23.685241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:23.685241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:23.685241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:23.685241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:23.685241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:23.685241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:23.685241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:23.685241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:23.685241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:23.686911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:23.686911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:23.686911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:23.686911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:23.686911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:23.686911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:23.686911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:23.686911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:23.686911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:23.686911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:23.686911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:23.686911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:23.686911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:23.686911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:23.686911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:23.686911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:23.686911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:23.688091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:23.688091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:23.688091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:23.692310 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 252/501] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:23.692310 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b871e1f-8554-4017-abfd-40aab988f2a4 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:23.695696 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:23.781835 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a64ed-b819-44c1-a1e9-e9ec8a78e03c None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:23.792345 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b871e1f-8554-4017-abfd-40aab988f2a4 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:23.816835 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd209d8-b9f9-4a75-913c-7a056d4c978b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:23.817434 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd209d8-b9f9-4a75-913c-7a056d4c978b None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:23.817715 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd209d8-b9f9-4a75-913c-7a056d4c978b None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:23.817995 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd209d8-b9f9-4a75-913c-7a056d4c978b None admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:23.818717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd209d8-b9f9-4a75-913c-7a056d4c978b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:23.819048 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd209d8-b9f9-4a75-913c-7a056d4c978b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:23.820494 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd209d8-b9f9-4a75-913c-7a056d4c978b None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:23.825662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc96a8-f293-498b-92a7-2581a74581cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:23.826248 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc96a8-f293-498b-92a7-2581a74581cc None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:23.826543 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc96a8-f293-498b-92a7-2581a74581cc None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:23.826814 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc96a8-f293-498b-92a7-2581a74581cc None admin] PATH_INFO: `/v3/users` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:23.827561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc96a8-f293-498b-92a7-2581a74581cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:23.827865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc96a8-f293-498b-92a7-2581a74581cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:23.829348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc96a8-f293-498b-92a7-2581a74581cc None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:23.856526 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 250/502] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 24 00:14:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:23.857359 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd209d8-b9f9-4a75-913c-7a056d4c978b None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:23.866804 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 253/503] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 24 00:14:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:23.868319 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc96a8-f293-498b-92a7-2581a74581cc None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:23.886719 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:23.930303 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:23.959473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd209d8-b9f9-4a75-913c-7a056d4c978b None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:23.969284 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc96a8-f293-498b-92a7-2581a74581cc None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:23.993637 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7370df-146c-4087-8faf-5279b8f3295f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:23.994231 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7370df-146c-4087-8faf-5279b8f3295f None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:23.994505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7370df-146c-4087-8faf-5279b8f3295f None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:23.994779 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7370df-146c-4087-8faf-5279b8f3295f None admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:23.995539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7370df-146c-4087-8faf-5279b8f3295f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:23.995842 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7370df-146c-4087-8faf-5279b8f3295f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:23.997291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7370df-146c-4087-8faf-5279b8f3295f None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:24.003067 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b13ad-94cc-46ba-a0f2-d984cffb5430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:24.003666 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b13ad-94cc-46ba-a0f2-d984cffb5430 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:24.003947 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b13ad-94cc-46ba-a0f2-d984cffb5430 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:24.004222 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b13ad-94cc-46ba-a0f2-d984cffb5430 None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:24.004865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b13ad-94cc-46ba-a0f2-d984cffb5430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:24.005198 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b13ad-94cc-46ba-a0f2-d984cffb5430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:24.006544 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b13ad-94cc-46ba-a0f2-d984cffb5430 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:24.014663 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 251/504] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 24 00:14:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:24.015403 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7370df-146c-4087-8faf-5279b8f3295f None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:24.019221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 254/505] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:24.019221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b13ad-94cc-46ba-a0f2-d984cffb5430 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:24.109304 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:24.119537 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b13ad-94cc-46ba-a0f2-d984cffb5430 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:24.129160 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7370df-146c-4087-8faf-5279b8f3295f None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:24.142218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:24.154315 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b9670-8281-45a3-97d6-75f0cfdefe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:24.155486 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b9670-8281-45a3-97d6-75f0cfdefe0e None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:24.155770 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b9670-8281-45a3-97d6-75f0cfdefe0e None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:24.156050 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b9670-8281-45a3-97d6-75f0cfdefe0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:24.165196 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09b208-3617-4ed0-9120-1f5b9b36fda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:24.165789 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09b208-3617-4ed0-9120-1f5b9b36fda1 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:24.166111 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09b208-3617-4ed0-9120-1f5b9b36fda1 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:24.166344 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09b208-3617-4ed0-9120-1f5b9b36fda1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:24.226295 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b9670-8281-45a3-97d6-75f0cfdefe0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:24.227731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b9670-8281-45a3-97d6-75f0cfdefe0e None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:24.235191 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09b208-3617-4ed0-9120-1f5b9b36fda1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:24.236772 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09b208-3617-4ed0-9120-1f5b9b36fda1 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:24.319335 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:24.327451 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 255/506] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:24.328289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b9670-8281-45a3-97d6-75f0cfdefe0e None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:24.337388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 252/507] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:24.338210 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09b208-3617-4ed0-9120-1f5b9b36fda1 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:24.355431 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:24.431586 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b9670-8281-45a3-97d6-75f0cfdefe0e None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:24.440316 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09b208-3617-4ed0-9120-1f5b9b36fda1 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:24.465524 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee92e40-64a7-46cb-999c-a21fd6dfba6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:24.466113 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee92e40-64a7-46cb-999c-a21fd6dfba6c None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:24.466388 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee92e40-64a7-46cb-999c-a21fd6dfba6c None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:24.466665 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee92e40-64a7-46cb-999c-a21fd6dfba6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:24.473763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee4cf0-5737-4079-af00-b9d4b4cee09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:24.474373 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee4cf0-5737-4079-af00-b9d4b4cee09f None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:24.474656 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee4cf0-5737-4079-af00-b9d4b4cee09f None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:24.474940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee4cf0-5737-4079-af00-b9d4b4cee09f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:24.482128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee4cf0-5737-4079-af00-b9d4b4cee09f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:24.484138 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee4cf0-5737-4079-af00-b9d4b4cee09f None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:24.495404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-67ee4cf0-5737-4079-af00-b9d4b4cee09f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 00:14:24.495404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:24.495404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:24.495404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:24.495404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:24.495404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:24.495404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:24.495404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:24.495404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:24.495404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:24.495404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:24.495404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:24.495404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:14:24.495404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:14:24.495404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:14:24.495404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:14:24.496363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:24.496363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:24.496363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:14:24.496363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:24.496363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:14:24.496363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:24.496363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:24.496363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:24.496363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:24.496363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:24.496363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:24.496363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:24.496363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:24.496363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:24.496363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:24.496363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:24.496363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:24.496363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:24.497240 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:24.497240 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:24.497240 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:14:24.497240 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:14:24.497240 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:14:24.497240 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:14:24.497240 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:14:24.497240 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:14:24.497240 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 00:14:24.497240 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:24.497240 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 253/508] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 00:14:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:24.497799 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee4cf0-5737-4079-af00-b9d4b4cee09f None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:24.540036 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee92e40-64a7-46cb-999c-a21fd6dfba6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:24.541509 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee92e40-64a7-46cb-999c-a21fd6dfba6c None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:24.549555 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:24.565797 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:24.605452 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee4cf0-5737-4079-af00-b9d4b4cee09f None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:24.639707 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e5202-9796-4cc2-9f4a-b76c964b507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:24.640324 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e5202-9796-4cc2-9f4a-b76c964b507d None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:24.640602 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e5202-9796-4cc2-9f4a-b76c964b507d None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:24.640870 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e5202-9796-4cc2-9f4a-b76c964b507d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:24.641549 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 256/509] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:24.646697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee92e40-64a7-46cb-999c-a21fd6dfba6c None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:24.651606 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e5202-9796-4cc2-9f4a-b76c964b507d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:24.653160 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e5202-9796-4cc2-9f4a-b76c964b507d None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:24.667512 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-462e5202-9796-4cc2-9f4a-b76c964b507d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:24.667512 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:24.667512 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:24.667512 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:24.667512 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:24.667512 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:24.667512 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:24.667512 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:24.667512 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:24.667512 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:24.667512 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:24.667512 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:24.667512 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:24.667512 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:24.667512 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:24.667512 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:24.668945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:24.668945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:24.668945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:24.668945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:24.668945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:24.668945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:24.668945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:24.668945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:24.668945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:24.668945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:24.668945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:24.668945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:24.668945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:24.668945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:24.668945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:24.668945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:24.668945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:24.669787 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:24.669787 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:24.669787 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:24.669787 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 254/510] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:24.669787 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e5202-9796-4cc2-9f4a-b76c964b507d None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:24.752868 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee92e40-64a7-46cb-999c-a21fd6dfba6c None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:24.764176 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:24.768164 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e5202-9796-4cc2-9f4a-b76c964b507d None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:24.775564 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:24.788011 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da82e64-c4b3-4bfe-9f00-ed0464d56152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:24.788627 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da82e64-c4b3-4bfe-9f00-ed0464d56152 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:24.788903 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da82e64-c4b3-4bfe-9f00-ed0464d56152 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:24.789194 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da82e64-c4b3-4bfe-9f00-ed0464d56152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:24.799895 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da82e64-c4b3-4bfe-9f00-ed0464d56152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:24.801333 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da82e64-c4b3-4bfe-9f00-ed0464d56152 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:24.803533 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a9cf0-cad4-49bb-a491-a9e9b4004e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:24.804135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a9cf0-cad4-49bb-a491-a9e9b4004e45 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:24.804415 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a9cf0-cad4-49bb-a491-a9e9b4004e45 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:24.804692 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a9cf0-cad4-49bb-a491-a9e9b4004e45 None admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:24.805418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a9cf0-cad4-49bb-a491-a9e9b4004e45 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:24.805730 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a9cf0-cad4-49bb-a491-a9e9b4004e45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:24.807195 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a9cf0-cad4-49bb-a491-a9e9b4004e45 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:24.815906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-5da82e64-c4b3-4bfe-9f00-ed0464d56152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:24.815906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:24.815906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:24.815906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:24.815906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:24.815906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:24.815906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:24.815906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:24.815906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:24.815906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:24.815906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:24.815906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:24.815906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:24.815906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:24.815906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:24.815906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:24.816873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:24.816873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:24.816873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:24.816873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:24.816873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:24.816873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:24.816873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:24.816873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:24.816873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:24.816873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:24.816873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:24.816873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:24.816873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:24.816873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:24.816873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:24.816873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:24.816873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:24.817731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:24.817731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:24.817731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:24.817731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 257/511] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:24.817965 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da82e64-c4b3-4bfe-9f00-ed0464d56152 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:24.831198 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 255/512] 10.222.0.42 () {56 vars in 1139 bytes} [Wed Aug 24 00:14:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:24.831198 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a9cf0-cad4-49bb-a491-a9e9b4004e45 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:24.917472 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da82e64-c4b3-4bfe-9f00-ed0464d56152 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:24.927398 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a9cf0-cad4-49bb-a491-a9e9b4004e45 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:24.950149 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d0b3b-d8c4-4293-902b-122195f12f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:24.950759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d0b3b-d8c4-4293-902b-122195f12f15 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:24.951065 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d0b3b-d8c4-4293-902b-122195f12f15 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:24.951867 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d0b3b-d8c4-4293-902b-122195f12f15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:24.961161 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a66f1-77c6-4b8a-bf02-eb1afc59e2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:24.961755 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a66f1-77c6-4b8a-bf02-eb1afc59e2be None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:24.962033 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a66f1-77c6-4b8a-bf02-eb1afc59e2be None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:24.962275 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d0b3b-d8c4-4293-902b-122195f12f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:24.962501 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a66f1-77c6-4b8a-bf02-eb1afc59e2be None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:24.962933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a66f1-77c6-4b8a-bf02-eb1afc59e2be None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:24.963269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a66f1-77c6-4b8a-bf02-eb1afc59e2be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:24.963808 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d0b3b-d8c4-4293-902b-122195f12f15 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:24.964630 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a66f1-77c6-4b8a-bf02-eb1afc59e2be None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:24.976383 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 256/513] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:24.976970 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a66f1-77c6-4b8a-bf02-eb1afc59e2be None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:24.978220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-049d0b3b-d8c4-4293-902b-122195f12f15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:24.978220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:24.978220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:24.978220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:24.978220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:24.978220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:24.978220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:24.978220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:24.978220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:24.978220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:24.978220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:24.978220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:24.978220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:24.978220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:24.978220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:24.978220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:24.979112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:24.979112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:24.979112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:24.979112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:24.979112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:24.979112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:24.979112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:24.979112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:24.979112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:24.979112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:24.979112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:24.979112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:24.979112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:24.979112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:24.979112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:24.979112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:24.979112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:24.979952 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:24.979952 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:24.979952 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:24.983277 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 258/514] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:24.983990 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d0b3b-d8c4-4293-902b-122195f12f15 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:24.996319 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:25.010739 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:25.080694 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a66f1-77c6-4b8a-bf02-eb1afc59e2be None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:25.082349 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d0b3b-d8c4-4293-902b-122195f12f15 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:25.113837 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5fcc6-2666-4a03-8708-560ab552b67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:25.114502 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5fcc6-2666-4a03-8708-560ab552b67f None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:25.114782 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5fcc6-2666-4a03-8708-560ab552b67f None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:25.115099 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5fcc6-2666-4a03-8708-560ab552b67f None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:25.115793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5fcc6-2666-4a03-8708-560ab552b67f None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:25.116100 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5fcc6-2666-4a03-8708-560ab552b67f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:25.116200 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912739ad-add0-4c0b-a352-a7e62216cb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:25.116698 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912739ad-add0-4c0b-a352-a7e62216cb46 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:25.116973 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912739ad-add0-4c0b-a352-a7e62216cb46 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:25.117240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912739ad-add0-4c0b-a352-a7e62216cb46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:25.117474 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5fcc6-2666-4a03-8708-560ab552b67f None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:25.129323 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 257/515] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:25.130126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5fcc6-2666-4a03-8708-560ab552b67f None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:25.187182 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912739ad-add0-4c0b-a352-a7e62216cb46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:25.188912 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912739ad-add0-4c0b-a352-a7e62216cb46 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:25.206627 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:25.216683 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:25.230379 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5fcc6-2666-4a03-8708-560ab552b67f None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:25.263245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf0ac7-e936-4409-93ab-8d5d8d31f9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:25.264415 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf0ac7-e936-4409-93ab-8d5d8d31f9ac None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:25.264691 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf0ac7-e936-4409-93ab-8d5d8d31f9ac None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:25.264957 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf0ac7-e936-4409-93ab-8d5d8d31f9ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:25.271363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf0ac7-e936-4409-93ab-8d5d8d31f9ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:25.272820 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf0ac7-e936-4409-93ab-8d5d8d31f9ac None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:25.284901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-09bf0ac7-e936-4409-93ab-8d5d8d31f9ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:25.284901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:25.284901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:25.284901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:25.284901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:25.284901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:25.284901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:25.284901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:25.284901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:25.284901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:25.284901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:25.284901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:25.284901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:14:25.284901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:14:25.284901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:14:25.285764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:14:25.285764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:25.285764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:25.285764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:25.285764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:25.285764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:25.285764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:25.285764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:25.285764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:25.285764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:25.285764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:25.285764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:25.285764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:25.285764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:25.285764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:25.285764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:25.285764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:25.286674 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:14:25.286674 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:14:25.286674 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:14:25.286674 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:14:25.286674 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:14:25.286674 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:14:25.286674 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:25.286674 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:25.286674 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 258/516] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:25.286674 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf0ac7-e936-4409-93ab-8d5d8d31f9ac None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:25.295286 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 259/517] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:25.296117 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912739ad-add0-4c0b-a352-a7e62216cb46 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:25.390144 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf0ac7-e936-4409-93ab-8d5d8d31f9ac None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:25.396042 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912739ad-add0-4c0b-a352-a7e62216cb46 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:25.421388 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:25.428305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85480e-1bba-4041-83fa-a95e49533a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:25.428911 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85480e-1bba-4041-83fa-a95e49533a8e None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:25.429192 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85480e-1bba-4041-83fa-a95e49533a8e None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:25.429467 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85480e-1bba-4041-83fa-a95e49533a8e None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:25.430141 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85480e-1bba-4041-83fa-a95e49533a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:25.430447 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85480e-1bba-4041-83fa-a95e49533a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:25.431030 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0704fc-8100-4e1c-b754-43c7c1c71cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:25.431640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0704fc-8100-4e1c-b754-43c7c1c71cb9 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:25.431861 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85480e-1bba-4041-83fa-a95e49533a8e None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:25.431956 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0704fc-8100-4e1c-b754-43c7c1c71cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:25.432169 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0704fc-8100-4e1c-b754-43c7c1c71cb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:25.434109 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:25.439668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0704fc-8100-4e1c-b754-43c7c1c71cb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:25.441192 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0704fc-8100-4e1c-b754-43c7c1c71cb9 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:25.444609 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 259/518] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:25.445409 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85480e-1bba-4041-83fa-a95e49533a8e None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:25.453196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-bb0704fc-8100-4e1c-b754-43c7c1c71cb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:25.453196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:25.453196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:25.453196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:25.453196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:25.453196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:25.453196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:25.453196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:25.453196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:25.453196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:25.453196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:25.453196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:25.453196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:14:25.453196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:14:25.453196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:14:25.454217 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:14:25.454217 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:25.454217 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:25.454217 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:25.454217 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:25.454217 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:25.454217 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:25.454217 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:25.454217 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:25.454217 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:25.454217 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:25.454217 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:25.454217 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:25.454217 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:25.454217 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:25.454217 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:25.454217 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:25.455122 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:14:25.455122 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:14:25.455122 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:14:25.455122 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:14:25.455122 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:14:25.455122 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:14:25.455122 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:25.455122 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:25.455122 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 260/519] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:25.455590 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0704fc-8100-4e1c-b754-43c7c1c71cb9 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:25.551947 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85480e-1bba-4041-83fa-a95e49533a8e None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:25.560523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0704fc-8100-4e1c-b754-43c7c1c71cb9 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:25.585575 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bf2b7-21a6-4acb-b112-9aca53184611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:25.586168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bf2b7-21a6-4acb-b112-9aca53184611 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:25.586449 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bf2b7-21a6-4acb-b112-9aca53184611 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:25.586716 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bf2b7-21a6-4acb-b112-9aca53184611 None admin] PATH_INFO: `/v3/projects` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:25.587468 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bf2b7-21a6-4acb-b112-9aca53184611 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:25.587772 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bf2b7-21a6-4acb-b112-9aca53184611 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:25.589207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bf2b7-21a6-4acb-b112-9aca53184611 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:25.594499 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad17b7-ae49-43b8-b53e-b558f3534d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:25.595139 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad17b7-ae49-43b8-b53e-b558f3534d27 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:25.595423 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad17b7-ae49-43b8-b53e-b558f3534d27 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:25.595694 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad17b7-ae49-43b8-b53e-b558f3534d27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:25.605995 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad17b7-ae49-43b8-b53e-b558f3534d27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:25.606124 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 260/520] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:14:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:25.606880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bf2b7-21a6-4acb-b112-9aca53184611 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:25.608131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad17b7-ae49-43b8-b53e-b558f3534d27 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:25.624816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-63ad17b7-ae49-43b8-b53e-b558f3534d27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:25.624816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:25.624816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:25.624816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:25.624816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:25.624816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:25.624816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:25.624816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:25.624816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:25.624816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:25.624816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:25.624816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:25.624816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:25.624816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:25.624816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:25.624816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:25.625863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:25.625863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:25.625863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:25.625863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:25.625863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:25.625863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:25.625863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:25.625863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:25.625863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:25.625863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:25.625863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:25.625863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:25.625863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:25.625863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:25.625863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:25.625863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:25.625863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:25.626695 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:25.626695 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:25.626695 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:25.626695 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 261/521] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:25.626917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad17b7-ae49-43b8-b53e-b558f3534d27 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:25.665872 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:25.668989 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:25.717091 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bf2b7-21a6-4acb-b112-9aca53184611 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:25.727241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad17b7-ae49-43b8-b53e-b558f3534d27 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:25.752211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42d81b-b365-4b31-a995-3afda95c0660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:25.752831 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42d81b-b365-4b31-a995-3afda95c0660 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:25.753109 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42d81b-b365-4b31-a995-3afda95c0660 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:25.753378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42d81b-b365-4b31-a995-3afda95c0660 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:25.759857 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42d81b-b365-4b31-a995-3afda95c0660 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:25.761316 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42d81b-b365-4b31-a995-3afda95c0660 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:25.761543 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e22e4f-d287-4798-a66f-a8d2885c3f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:25.762142 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e22e4f-d287-4798-a66f-a8d2885c3f11 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:25.762422 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e22e4f-d287-4798-a66f-a8d2885c3f11 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:25.762700 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e22e4f-d287-4798-a66f-a8d2885c3f11 None admin] PATH_INFO: `/v3/projects` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:25.763420 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e22e4f-d287-4798-a66f-a8d2885c3f11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:25.763957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e22e4f-d287-4798-a66f-a8d2885c3f11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:25.765185 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e22e4f-d287-4798-a66f-a8d2885c3f11 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:25.772291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-ca42d81b-b365-4b31-a995-3afda95c0660 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:25.772291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:25.772291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:25.772291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:25.772291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:25.772291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:25.772291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:25.772291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:25.772291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:25.772291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:25.772291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:25.772291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:25.772291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:14:25.772291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:14:25.772291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:14:25.773292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:14:25.773292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:25.773292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:25.773292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:25.773292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:25.773292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:25.773292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:25.773292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:25.773292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:25.773292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:25.773292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:25.773292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:25.773292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:25.773292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:25.773292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:25.773292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:25.773292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:25.774160 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:14:25.774160 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:14:25.774160 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:14:25.774160 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:14:25.774160 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:14:25.774160 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:14:25.774160 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:25.774160 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:25.774160 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 261/522] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:25.774619 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42d81b-b365-4b31-a995-3afda95c0660 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:25.783031 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 262/523] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:14:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:25.783759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e22e4f-d287-4798-a66f-a8d2885c3f11 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:25.875421 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42d81b-b365-4b31-a995-3afda95c0660 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:25.880415 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:25.885088 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e22e4f-d287-4798-a66f-a8d2885c3f11 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:25.891262 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:25.909191 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934a8d0-2aea-415c-bec0-8799a679f7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:25.909784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934a8d0-2aea-415c-bec0-8799a679f7c1 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:25.910064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934a8d0-2aea-415c-bec0-8799a679f7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:25.910336 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934a8d0-2aea-415c-bec0-8799a679f7c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:25.911087 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934a8d0-2aea-415c-bec0-8799a679f7c1 None admin] RBAC: Adding query filter params (role.id=85e127a1e1b348d6bf45890be6c68b1d, scope.project.id=a63a68d37106431e80bd876cdce3e5fa, user.id=b588c52178934bce8cceff804a8f6e38) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:25.911395 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934a8d0-2aea-415c-bec0-8799a679f7c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:25.912876 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934a8d0-2aea-415c-bec0-8799a679f7c1 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:25.918028 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 262/524] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:14:25 2022] GET /identity/v3/role_assignments?user.id=b588c52178934bce8cceff804a8f6e38&scope.project.id=a63a68d37106431e80bd876cdce3e5fa&role.id=85e127a1e1b348d6bf45890be6c68b1d => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:25.918177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8128e7-bdab-457c-8459-749f3f7e1fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:25.918746 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8128e7-bdab-457c-8459-749f3f7e1fda None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:25.918846 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934a8d0-2aea-415c-bec0-8799a679f7c1 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:25.919167 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8128e7-bdab-457c-8459-749f3f7e1fda None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:25.919358 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8128e7-bdab-457c-8459-749f3f7e1fda None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:25.920508 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8128e7-bdab-457c-8459-749f3f7e1fda None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:25.920818 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8128e7-bdab-457c-8459-749f3f7e1fda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:25.922229 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8128e7-bdab-457c-8459-749f3f7e1fda None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:25.935430 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 263/525] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:25.937390 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8128e7-bdab-457c-8459-749f3f7e1fda None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:26.050360 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934a8d0-2aea-415c-bec0-8799a679f7c1 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:26.052830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8128e7-bdab-457c-8459-749f3f7e1fda None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:26.087805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98836c-ccd4-407d-90d6-1225b7c2dafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:26.088419 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98836c-ccd4-407d-90d6-1225b7c2dafc None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:26.088702 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98836c-ccd4-407d-90d6-1225b7c2dafc None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:26.088977 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98836c-ccd4-407d-90d6-1225b7c2dafc None admin] PATH_INFO: `/v3/projects` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:26.089682 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98836c-ccd4-407d-90d6-1225b7c2dafc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:26.089989 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98836c-ccd4-407d-90d6-1225b7c2dafc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:26.090671 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4f614-294f-42ee-a987-1ef2f39fb104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:26.091303 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4f614-294f-42ee-a987-1ef2f39fb104 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:26.091484 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98836c-ccd4-407d-90d6-1225b7c2dafc None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:26.091588 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4f614-294f-42ee-a987-1ef2f39fb104 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:26.092386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4f614-294f-42ee-a987-1ef2f39fb104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:26.093273 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4f614-294f-42ee-a987-1ef2f39fb104 None admin] RBAC: Adding query filter params (role.id=85e127a1e1b348d6bf45890be6c68b1d, scope.project.id=a63a68d37106431e80bd876cdce3e5fa, user.id=a863e95438d14892816e4f3c94673025) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:26.093450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4f614-294f-42ee-a987-1ef2f39fb104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:26.094883 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4f614-294f-42ee-a987-1ef2f39fb104 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:26.102561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 264/526] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:14:25 2022] GET /identity/v3/role_assignments?user.id=a863e95438d14892816e4f3c94673025&scope.project.id=a63a68d37106431e80bd876cdce3e5fa&role.id=85e127a1e1b348d6bf45890be6c68b1d => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:26.104010 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4f614-294f-42ee-a987-1ef2f39fb104 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:26.111633 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 263/527] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:14:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:26.112568 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98836c-ccd4-407d-90d6-1225b7c2dafc None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:26.137065 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:26.186172 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:26.239956 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4f614-294f-42ee-a987-1ef2f39fb104 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:26.271365 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98836c-ccd4-407d-90d6-1225b7c2dafc None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:26.281468 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eff7e6-78d8-4eca-913f-cde01f4ae5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:26.282116 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eff7e6-78d8-4eca-913f-cde01f4ae5fa None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:26.282399 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eff7e6-78d8-4eca-913f-cde01f4ae5fa None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:26.282676 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eff7e6-78d8-4eca-913f-cde01f4ae5fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:26.292131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eff7e6-78d8-4eca-913f-cde01f4ae5fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:26.293738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eff7e6-78d8-4eca-913f-cde01f4ae5fa None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:26.307721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-39eff7e6-78d8-4eca-913f-cde01f4ae5fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:26.307721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:26.307721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:26.307721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:26.307721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:26.307721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:26.307721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:26.307721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:26.307721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:26.307721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:26.307721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:26.307721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:26.307721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:14:26.307721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:14:26.307721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:14:26.308574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:14:26.308574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:26.308574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:26.308574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:26.308574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:26.308574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:26.308574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:26.308574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:26.308574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:26.308574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:26.308574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:26.308574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:26.308574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:26.308574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:26.308574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:26.308574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:26.308574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:26.309421 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:14:26.309421 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:14:26.309421 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:14:26.309421 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:14:26.309421 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:14:26.309421 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:14:26.309421 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:26.309421 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:26.309421 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 265/528] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:26.315117 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eff7e6-78d8-4eca-913f-cde01f4ae5fa None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:26.323243 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443813e-df59-4e41-a53d-b2623eba7fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:26.324198 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443813e-df59-4e41-a53d-b2623eba7fb0 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:26.324783 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443813e-df59-4e41-a53d-b2623eba7fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:26.325056 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443813e-df59-4e41-a53d-b2623eba7fb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:26.325838 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443813e-df59-4e41-a53d-b2623eba7fb0 None admin] RBAC: Adding query filter params (role.id=85e127a1e1b348d6bf45890be6c68b1d, scope.project.id=a63a68d37106431e80bd876cdce3e5fa, user.id=c43d7aa4ecfc4a598bbaa4f4fc4e4590) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:26.326189 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443813e-df59-4e41-a53d-b2623eba7fb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:26.328040 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443813e-df59-4e41-a53d-b2623eba7fb0 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:26.343143 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 264/529] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:14:26 2022] GET /identity/v3/role_assignments?user.id=c43d7aa4ecfc4a598bbaa4f4fc4e4590&scope.project.id=a63a68d37106431e80bd876cdce3e5fa&role.id=85e127a1e1b348d6bf45890be6c68b1d => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:26.421301 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:26.439202 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eff7e6-78d8-4eca-913f-cde01f4ae5fa None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:26.480285 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088e8b8-cb76-471c-9939-6fc0b0b54eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:26.481012 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088e8b8-cb76-471c-9939-6fc0b0b54eb7 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:26.481294 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088e8b8-cb76-471c-9939-6fc0b0b54eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:26.481615 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088e8b8-cb76-471c-9939-6fc0b0b54eb7 None admin] PATH_INFO: `/v3/projects` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:26.482326 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088e8b8-cb76-471c-9939-6fc0b0b54eb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:26.482674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088e8b8-cb76-471c-9939-6fc0b0b54eb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:26.484206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088e8b8-cb76-471c-9939-6fc0b0b54eb7 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:26.502399 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 266/530] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:14:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:26.508144 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443813e-df59-4e41-a53d-b2623eba7fb0 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:26.624907 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443813e-df59-4e41-a53d-b2623eba7fb0 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:26.627261 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:26.665372 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf764c6-d434-4f64-a396-e953a14d5b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:26.665980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf764c6-d434-4f64-a396-e953a14d5b90 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:26.666261 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf764c6-d434-4f64-a396-e953a14d5b90 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:26.666534 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf764c6-d434-4f64-a396-e953a14d5b90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:26.667310 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf764c6-d434-4f64-a396-e953a14d5b90 None admin] RBAC: Adding query filter params (role.id=85e127a1e1b348d6bf45890be6c68b1d, scope.project.id=a63a68d37106431e80bd876cdce3e5fa, user.id=ad894f6b3613401c88cd3b39d825e61d) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:26.667618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf764c6-d434-4f64-a396-e953a14d5b90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:26.669128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf764c6-d434-4f64-a396-e953a14d5b90 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:26.679119 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 265/531] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:14:26 2022] GET /identity/v3/role_assignments?user.id=ad894f6b3613401c88cd3b39d825e61d&scope.project.id=a63a68d37106431e80bd876cdce3e5fa&role.id=85e127a1e1b348d6bf45890be6c68b1d => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:28.205707 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1e961-dbaf-4960-809f-419e94908b95 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:28.206262 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1e961-dbaf-4960-809f-419e94908b95 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:28.206262 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1e961-dbaf-4960-809f-419e94908b95 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:28.208421 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 267/532] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:28.214813 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647cd1e-8503-49dd-8a6c-0adcfc227522 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:28.215348 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647cd1e-8503-49dd-8a6c-0adcfc227522 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:28.215443 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647cd1e-8503-49dd-8a6c-0adcfc227522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:28.236011 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-f647cd1e-8503-49dd-8a6c-0adcfc227522 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:28.237211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-f647cd1e-8503-49dd-8a6c-0adcfc227522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:28.318089 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 266/533] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:28.386880 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fba6a7-4dd4-4cc6-b1ea-205d0c268bde None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:28.387374 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fba6a7-4dd4-4cc6-b1ea-205d0c268bde None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:28.387741 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fba6a7-4dd4-4cc6-b1ea-205d0c268bde None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:28.389986 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 268/534] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:28.395386 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b12d3-d1b7-44b2-b251-328d976c3121 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:28.395672 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b12d3-d1b7-44b2-b251-328d976c3121 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:28.395946 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b12d3-d1b7-44b2-b251-328d976c3121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:28.415205 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-a50b12d3-d1b7-44b2-b251-328d976c3121 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:28.416408 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-a50b12d3-d1b7-44b2-b251-328d976c3121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:28.488367 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 267/535] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:28.659424 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10c5ac-c4cd-466e-aadb-86aa16ff3863 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:28.659769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10c5ac-c4cd-466e-aadb-86aa16ff3863 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:28.659974 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10c5ac-c4cd-466e-aadb-86aa16ff3863 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:28.661663 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 269/536] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:28.662661 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b12d3-d1b7-44b2-b251-328d976c3121 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:28.669469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85179291-5c0e-43f7-b830-d86cdad246fa None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:28.670050 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85179291-5c0e-43f7-b830-d86cdad246fa None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:28.670527 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85179291-5c0e-43f7-b830-d86cdad246fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:28.700805 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-85179291-5c0e-43f7-b830-d86cdad246fa None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:28.702686 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-85179291-5c0e-43f7-b830-d86cdad246fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:28.708056 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:28.795313 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 270/537] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:14:28.808794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b12d3-d1b7-44b2-b251-328d976c3121 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:28.843290 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85179291-5c0e-43f7-b830-d86cdad246fa None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:28.847694 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e1d74-a097-454e-a411-bfd66359e151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:28.848339 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e1d74-a097-454e-a411-bfd66359e151 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:28.848619 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e1d74-a097-454e-a411-bfd66359e151 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:28.848892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e1d74-a097-454e-a411-bfd66359e151 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:28.860903 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e1d74-a097-454e-a411-bfd66359e151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:28.866245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-ed3e1d74-a097-454e-a411-bfd66359e151 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:28.866245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:28.866245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:28.866245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:28.866245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:28.866245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:28.866245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:28.866245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:28.866245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:28.866245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:28.866245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:28.866245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:28.866245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:28.866245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:28.866245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:28.866245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:28.867154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:28.867154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:28.867154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:28.867154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:28.867154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:28.867154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:28.867154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:28.867154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:28.867154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:28.867154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:28.867154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:28.867154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:28.867154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:28.867154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:28.867154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:28.867154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:28.867965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:28.867965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:28.867965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:28.867965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:28.867965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:28.867965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:28.867965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:28.867965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:28.867965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:28.867965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:28.867965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:28.867965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:28.872329 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 268/538] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 00:14:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:28.873943 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e1d74-a097-454e-a411-bfd66359e151 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:28.931741 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:28.966198 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:28.970470 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85179291-5c0e-43f7-b830-d86cdad246fa None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:28.981559 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e1d74-a097-454e-a411-bfd66359e151 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:29.007013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce693b-23ef-48d1-83ae-9e67ea241844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:29.007916 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce693b-23ef-48d1-83ae-9e67ea241844 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:29.008409 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce693b-23ef-48d1-83ae-9e67ea241844 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:29.008883 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce693b-23ef-48d1-83ae-9e67ea241844 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:29.017934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca227fa5-7d51-449c-a766-16ceabd03992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:29.018646 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227fa5-7d51-449c-a766-16ceabd03992 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:29.018921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227fa5-7d51-449c-a766-16ceabd03992 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:29.019133 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227fa5-7d51-449c-a766-16ceabd03992 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:29.019397 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce693b-23ef-48d1-83ae-9e67ea241844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:29.019812 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca227fa5-7d51-449c-a766-16ceabd03992 None admin] RBAC: Adding query filter params (name=service) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:29.020213 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca227fa5-7d51-449c-a766-16ceabd03992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:29.021708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca227fa5-7d51-449c-a766-16ceabd03992 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:29.024136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-92ce693b-23ef-48d1-83ae-9e67ea241844 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:29.024136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:29.024136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:29.024136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:29.024136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:29.024136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:29.024136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:29.024136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:29.024136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:29.024136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:29.024136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:29.024136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:29.024136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:29.024136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:29.024136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:29.024136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:29.024978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:29.024978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:29.024978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:29.024978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:29.024978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:29.024978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:29.024978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:29.024978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:29.024978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:29.024978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:29.024978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:29.024978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:29.024978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:29.024978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:29.024978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:29.024978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:29.025768 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:29.025768 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:29.025768 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:29.025768 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:29.025768 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:29.025768 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:29.025768 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:29.025768 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:29.025768 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:29.025768 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:29.025768 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:29.025768 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:29.030768 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 269/540] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 00:14:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:29.030881 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 271/540] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 00:14:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:29.031871 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f42133-df92-4526-bd71-bc27a34929cd None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:29.032161 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f42133-df92-4526-bd71-bc27a34929cd None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:29.032435 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f42133-df92-4526-bd71-bc27a34929cd None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:29.033767 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 270/541] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:29.036214 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f42133-df92-4526-bd71-bc27a34929cd None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:29.036328 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce693b-23ef-48d1-83ae-9e67ea241844 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:29.140229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f42133-df92-4526-bd71-bc27a34929cd None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:29.142076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce693b-23ef-48d1-83ae-9e67ea241844 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:29.171689 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:29.174284 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef537e11-9eff-46e1-9fd8-6c90a9b7eee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:29.174908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef537e11-9eff-46e1-9fd8-6c90a9b7eee0 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:29.175224 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef537e11-9eff-46e1-9fd8-6c90a9b7eee0 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:29.175496 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef537e11-9eff-46e1-9fd8-6c90a9b7eee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:29.177282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e74e8f-6dfa-4c20-9776-201b72137e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:29.177868 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e74e8f-6dfa-4c20-9776-201b72137e34 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:29.178144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e74e8f-6dfa-4c20-9776-201b72137e34 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:29.178410 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e74e8f-6dfa-4c20-9776-201b72137e34 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:29.179093 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e74e8f-6dfa-4c20-9776-201b72137e34 None admin] RBAC: Adding query filter params (name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:29.179394 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e74e8f-6dfa-4c20-9776-201b72137e34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:29.180781 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e74e8f-6dfa-4c20-9776-201b72137e34 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:29.186277 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef537e11-9eff-46e1-9fd8-6c90a9b7eee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:29.187738 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef537e11-9eff-46e1-9fd8-6c90a9b7eee0 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:29.189080 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 272/542] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 00:14:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:29.190267 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12128b8d-4d4e-4f77-a2c7-1e9427c4a7c1 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:29.190550 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12128b8d-4d4e-4f77-a2c7-1e9427c4a7c1 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:29.190819 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12128b8d-4d4e-4f77-a2c7-1e9427c4a7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:29.206540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-ef537e11-9eff-46e1-9fd8-6c90a9b7eee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:29.206540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:29.206540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:29.206540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:29.206540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:29.206540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:29.206540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:29.206540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:29.206540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:29.206540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:29.206540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:29.206540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:29.206540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:29.206540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:29.206540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:29.206540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:29.207929 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:29.207929 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:29.207929 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:29.207929 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:29.207929 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:29.207929 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:29.207929 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:29.207929 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:29.207929 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:29.207929 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:29.207929 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:29.207929 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:29.207929 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:29.207929 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:29.207929 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:29.207929 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:29.207929 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:29.208836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:29.208836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:29.208836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:29.208836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 271/543] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:29.209055 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-12128b8d-4d4e-4f77-a2c7-1e9427c4a7c1 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:29.209441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef537e11-9eff-46e1-9fd8-6c90a9b7eee0 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:29.209520 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-12128b8d-4d4e-4f77-a2c7-1e9427c4a7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:29.215188 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:29.275011 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 273/544] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:29.275928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12128b8d-4d4e-4f77-a2c7-1e9427c4a7c1 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:29.329683 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef537e11-9eff-46e1-9fd8-6c90a9b7eee0 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:29.366627 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23076c0c-8680-4f60-9785-713fa0299dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:29.367368 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076c0c-8680-4f60-9785-713fa0299dd1 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:29.367659 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076c0c-8680-4f60-9785-713fa0299dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:29.367927 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076c0c-8680-4f60-9785-713fa0299dd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:29.380756 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23076c0c-8680-4f60-9785-713fa0299dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:29.381753 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12128b8d-4d4e-4f77-a2c7-1e9427c4a7c1 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:29.386320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-23076c0c-8680-4f60-9785-713fa0299dd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:29.386320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:29.386320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:29.386320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:29.386320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:29.386320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:29.386320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:29.386320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:29.386320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:29.386320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:29.386320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:29.386320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:29.386320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:29.386320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:29.386320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:29.386320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:29.388082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:29.388082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:29.388082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:29.388082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:29.388082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:29.388082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:29.388082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:29.388082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:29.388082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:29.388082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:29.388082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:29.388082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:29.388082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:29.388082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:29.388082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:29.388082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:29.393703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:29.393703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:29.393703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:29.393703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:29.393703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:29.393703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:29.393703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:29.393703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:29.393703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:29.393703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:29.393703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:29.393703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:29.393703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 272/545] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 00:14:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:29.394506 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23076c0c-8680-4f60-9785-713fa0299dd1 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:29.413378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:29.432017 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b401f-bc22-4ebe-a142-5dec616cca69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:29.432782 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b401f-bc22-4ebe-a142-5dec616cca69 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:29.433167 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b401f-bc22-4ebe-a142-5dec616cca69 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:29.433545 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b401f-bc22-4ebe-a142-5dec616cca69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:29.445848 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b401f-bc22-4ebe-a142-5dec616cca69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:29.448742 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b401f-bc22-4ebe-a142-5dec616cca69 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:29.459408 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:29.470857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-225b401f-bc22-4ebe-a142-5dec616cca69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:29.470857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:29.470857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:29.470857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:29.470857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:29.470857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:29.470857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:29.470857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:29.470857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:29.470857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:29.470857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:29.470857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:29.470857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:29.470857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:29.470857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:29.470857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:29.472008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:29.472008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:29.472008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:29.472008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:29.472008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:29.472008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:29.472008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:29.472008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:29.472008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:29.472008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:29.472008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:29.472008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:29.472008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:29.472008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:29.472008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:29.472008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:29.472008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:29.473053 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:29.473053 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:29.473053 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:29.473667 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 274/546] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:29.474470 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b401f-bc22-4ebe-a142-5dec616cca69 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:29.508941 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23076c0c-8680-4f60-9785-713fa0299dd1 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:29.545991 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c8cdd-e0d7-4db1-b1b4-f57da6a8a019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:29.546503 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c8cdd-e0d7-4db1-b1b4-f57da6a8a019 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:29.546779 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c8cdd-e0d7-4db1-b1b4-f57da6a8a019 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:29.547070 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c8cdd-e0d7-4db1-b1b4-f57da6a8a019 None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:29.547709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c8cdd-e0d7-4db1-b1b4-f57da6a8a019 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:29.548012 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c8cdd-e0d7-4db1-b1b4-f57da6a8a019 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:29.549380 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c8cdd-e0d7-4db1-b1b4-f57da6a8a019 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:29.566098 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 273/547] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:29.566098 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c8cdd-e0d7-4db1-b1b4-f57da6a8a019 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:29.595654 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b401f-bc22-4ebe-a142-5dec616cca69 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:29.630434 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a687ba1-abcd-4789-8987-dca868881dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:29.631052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a687ba1-abcd-4789-8987-dca868881dfd None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:29.631335 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a687ba1-abcd-4789-8987-dca868881dfd None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:29.631609 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a687ba1-abcd-4789-8987-dca868881dfd None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:29.632270 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a687ba1-abcd-4789-8987-dca868881dfd None admin] RBAC: Adding query filter params (name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:29.632575 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a687ba1-abcd-4789-8987-dca868881dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:29.633945 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a687ba1-abcd-4789-8987-dca868881dfd None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:29.642410 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 275/548] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 00:14:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:29.643215 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a687ba1-abcd-4789-8987-dca868881dfd None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:29.666209 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c8cdd-e0d7-4db1-b1b4-f57da6a8a019 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:29.682562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:29.691267 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:29.703714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8aaea0-5f53-45c1-8272-724140d58149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:29.704310 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8aaea0-5f53-45c1-8272-724140d58149 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:29.704587 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8aaea0-5f53-45c1-8272-724140d58149 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:29.704865 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8aaea0-5f53-45c1-8272-724140d58149 None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:29.705504 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8aaea0-5f53-45c1-8272-724140d58149 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:29.705806 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8aaea0-5f53-45c1-8272-724140d58149 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:29.707322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8aaea0-5f53-45c1-8272-724140d58149 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:29.718742 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 274/549] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:29.719573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8aaea0-5f53-45c1-8272-724140d58149 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:29.743050 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a687ba1-abcd-4789-8987-dca868881dfd None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:29.779140 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f563b-342b-4930-9863-a1b93f5f9dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:29.779761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f563b-342b-4930-9863-a1b93f5f9dae None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:29.780034 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f563b-342b-4930-9863-a1b93f5f9dae None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:29.780302 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f563b-342b-4930-9863-a1b93f5f9dae None admin] PATH_INFO: `/v3/users/glance` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:29.787723 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f563b-342b-4930-9863-a1b93f5f9dae None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:29.789180 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f563b-342b-4930-9863-a1b93f5f9dae None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:29.799949 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-783f563b-342b-4930-9863-a1b93f5f9dae None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 00:14:29.799949 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:29.799949 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:29.799949 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:29.799949 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:29.799949 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:29.799949 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:29.799949 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:29.799949 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:29.799949 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:29.799949 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:29.799949 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:29.799949 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:14:29.799949 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:14:29.799949 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:14:29.799949 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:14:29.800982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:29.800982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:29.800982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:14:29.800982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:29.800982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:14:29.800982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:29.800982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:29.800982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:29.800982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:29.800982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:29.800982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:29.800982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:29.800982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:29.800982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:29.800982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:29.800982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:29.800982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:29.800982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:29.802007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:29.802007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:29.802007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:14:29.802007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:14:29.802007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:14:29.802007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:14:29.802007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:14:29.802007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:14:29.802007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 00:14:29.802007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:29.802007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 276/550] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:29.802007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f563b-342b-4930-9863-a1b93f5f9dae None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:29.840620 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8aaea0-5f53-45c1-8272-724140d58149 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:29.873825 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fdbc1-1ede-47bc-9043-6fcc89f7e88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:29.874532 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fdbc1-1ede-47bc-9043-6fcc89f7e88d None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:29.874894 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fdbc1-1ede-47bc-9043-6fcc89f7e88d None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:29.875244 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fdbc1-1ede-47bc-9043-6fcc89f7e88d None admin] PATH_INFO: `/v3/roles/service` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:29.885275 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fdbc1-1ede-47bc-9043-6fcc89f7e88d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:29.890892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-934fdbc1-1ede-47bc-9043-6fcc89f7e88d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:29.890892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:29.890892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:29.890892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:29.890892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:29.890892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:29.890892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:29.890892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:29.890892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:29.890892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:29.890892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:29.890892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:29.890892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:29.890892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:29.890892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:29.890892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:29.891921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:29.891921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:29.891921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:29.891921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:29.891921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:29.891921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:29.891921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:29.891921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:29.891921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:29.891921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:29.891921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:29.891921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:29.891921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:29.891921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:29.891921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:29.891921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:29.892740 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:29.892740 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:29.892740 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:29.892740 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:29.892740 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:29.892740 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:29.892740 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:29.892740 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:29.892740 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:29.892740 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:29.892740 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:29.892740 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:29.892740 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 275/551] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 00:14:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:29.893928 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fdbc1-1ede-47bc-9043-6fcc89f7e88d None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:29.900655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:29.904476 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f563b-342b-4930-9863-a1b93f5f9dae None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:29.936855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:29.938983 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f555a-a068-4f52-a0a9-0c1407e428e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:29.939639 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f555a-a068-4f52-a0a9-0c1407e428e3 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:29.939917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f555a-a068-4f52-a0a9-0c1407e428e3 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:29.940189 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f555a-a068-4f52-a0a9-0c1407e428e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:29.950655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f555a-a068-4f52-a0a9-0c1407e428e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:29.952180 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f555a-a068-4f52-a0a9-0c1407e428e3 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:29.965967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-fa9f555a-a068-4f52-a0a9-0c1407e428e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:29.965967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:29.965967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:29.965967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:29.965967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:29.965967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:29.965967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:29.965967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:29.965967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:29.965967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:29.965967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:29.965967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:29.965967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:29.965967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:29.965967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:29.965967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:29.967793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:29.967793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:29.967793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:29.967793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:29.967793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:29.967793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:29.967793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:29.967793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:29.967793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:29.967793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:29.967793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:29.967793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:29.967793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:29.967793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:29.967793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:29.967793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:29.967793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:29.968809 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:29.968809 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:29.968809 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:29.968809 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 277/552] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:29.968809 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f555a-a068-4f52-a0a9-0c1407e428e3 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:30.001673 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fdbc1-1ede-47bc-9043-6fcc89f7e88d None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:30.040409 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b5b86-2104-4c97-b2ec-180469e0e563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:30.041034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b5b86-2104-4c97-b2ec-180469e0e563 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:30.041309 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b5b86-2104-4c97-b2ec-180469e0e563 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:30.041581 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b5b86-2104-4c97-b2ec-180469e0e563 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:30.049558 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b5b86-2104-4c97-b2ec-180469e0e563 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:30.051027 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b5b86-2104-4c97-b2ec-180469e0e563 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:30.062551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-6e5b5b86-2104-4c97-b2ec-180469e0e563 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:14:30.062551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:30.062551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:30.062551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:30.062551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:30.062551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:30.062551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:30.062551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:30.062551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:30.062551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:30.062551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:30.062551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:30.062551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:14:30.062551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:14:30.062551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:14:30.062551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:14:30.063983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:30.063983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:30.063983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:14:30.063983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:30.063983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:14:30.063983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:30.063983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:30.063983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:30.063983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:30.063983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:30.063983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:30.063983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:30.063983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:30.063983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:30.063983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:30.063983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:30.063983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:30.063983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:30.065256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:30.065256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:30.065256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:14:30.065256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:14:30.065256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:14:30.065256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:14:30.065256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:14:30.065256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:14:30.065256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:14:30.065256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:30.065256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 276/553] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 24 00:14:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:30.065256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b5b86-2104-4c97-b2ec-180469e0e563 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:30.074842 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f555a-a068-4f52-a0a9-0c1407e428e3 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:30.109468 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f47db-3331-4685-8640-369edf13a0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:30.110067 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f47db-3331-4685-8640-369edf13a0a1 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:30.110347 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f47db-3331-4685-8640-369edf13a0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:30.110623 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f47db-3331-4685-8640-369edf13a0a1 None admin] PATH_INFO: `/v3/users` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:30.111388 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f47db-3331-4685-8640-369edf13a0a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:30.111699 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f47db-3331-4685-8640-369edf13a0a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:30.113316 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f47db-3331-4685-8640-369edf13a0a1 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:30.130484 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 278/554] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 24 00:14:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:30.131319 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f47db-3331-4685-8640-369edf13a0a1 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:30.141937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:30.180215 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b5b86-2104-4c97-b2ec-180469e0e563 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:30.181733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:30.215234 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e0ee9-6900-4da8-9f45-058030f1ca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:30.215852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e0ee9-6900-4da8-9f45-058030f1ca81 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:30.216022 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e0ee9-6900-4da8-9f45-058030f1ca81 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:30.216300 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e0ee9-6900-4da8-9f45-058030f1ca81 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:30.217519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e0ee9-6900-4da8-9f45-058030f1ca81 None admin] RBAC: Adding query filter params (name=service) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:30.218096 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e0ee9-6900-4da8-9f45-058030f1ca81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:30.219507 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e0ee9-6900-4da8-9f45-058030f1ca81 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:30.227350 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 277/555] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 00:14:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:30.228134 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e0ee9-6900-4da8-9f45-058030f1ca81 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:30.231209 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f47db-3331-4685-8640-369edf13a0a1 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:30.265179 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1497d-0ccc-4433-abd9-19a605dc4be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:30.265769 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1497d-0ccc-4433-abd9-19a605dc4be5 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:30.266046 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1497d-0ccc-4433-abd9-19a605dc4be5 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:30.266315 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1497d-0ccc-4433-abd9-19a605dc4be5 None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:30.266948 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1497d-0ccc-4433-abd9-19a605dc4be5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:30.267275 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1497d-0ccc-4433-abd9-19a605dc4be5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:30.268638 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1497d-0ccc-4433-abd9-19a605dc4be5 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:30.280282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 279/556] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:30.280937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1497d-0ccc-4433-abd9-19a605dc4be5 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:30.326753 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e0ee9-6900-4da8-9f45-058030f1ca81 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:30.349549 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:30.360205 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb69240-96c6-4d28-8e4c-c26bfef67384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:30.360901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb69240-96c6-4d28-8e4c-c26bfef67384 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:30.361156 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb69240-96c6-4d28-8e4c-c26bfef67384 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:30.361425 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb69240-96c6-4d28-8e4c-c26bfef67384 None admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:30.362146 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb69240-96c6-4d28-8e4c-c26bfef67384 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:30.362447 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb69240-96c6-4d28-8e4c-c26bfef67384 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:30.364227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb69240-96c6-4d28-8e4c-c26bfef67384 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:30.387105 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 278/557] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 24 00:14:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:30.387105 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb69240-96c6-4d28-8e4c-c26bfef67384 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:30.387362 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1497d-0ccc-4433-abd9-19a605dc4be5 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:30.414366 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:30.424216 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dd283-9828-4547-8fba-ccb2fe4d6661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:30.424832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dd283-9828-4547-8fba-ccb2fe4d6661 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:30.425115 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dd283-9828-4547-8fba-ccb2fe4d6661 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:30.425383 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dd283-9828-4547-8fba-ccb2fe4d6661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:30.436010 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dd283-9828-4547-8fba-ccb2fe4d6661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:30.437485 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dd283-9828-4547-8fba-ccb2fe4d6661 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:30.452218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-a01dd283-9828-4547-8fba-ccb2fe4d6661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:30.452218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:30.452218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:30.452218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:30.452218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:30.452218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:30.452218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:30.452218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:30.452218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:30.452218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:30.452218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:30.452218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:30.452218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:30.452218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:30.452218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:30.452218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:30.453190 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:30.453190 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:30.453190 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:30.453190 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:30.453190 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:30.453190 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:30.453190 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:30.453190 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:30.453190 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:30.453190 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:30.453190 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:30.453190 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:30.453190 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:30.453190 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:30.453190 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:30.453190 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:30.453190 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:30.454144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:30.454144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:30.454144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:30.454144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 280/558] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:30.454144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dd283-9828-4547-8fba-ccb2fe4d6661 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:30.492569 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb69240-96c6-4d28-8e4c-c26bfef67384 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:30.529881 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741ba96-933e-4512-87f6-e4c871691cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:30.530504 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741ba96-933e-4512-87f6-e4c871691cde None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:30.530779 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741ba96-933e-4512-87f6-e4c871691cde None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:30.531076 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741ba96-933e-4512-87f6-e4c871691cde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:30.541287 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741ba96-933e-4512-87f6-e4c871691cde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:30.542732 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741ba96-933e-4512-87f6-e4c871691cde None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:30.553811 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dd283-9828-4547-8fba-ccb2fe4d6661 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:30.557599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-9741ba96-933e-4512-87f6-e4c871691cde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:30.557599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:30.557599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:30.557599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:30.557599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:30.557599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:30.557599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:30.557599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:30.557599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:30.557599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:30.557599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:30.557599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:30.557599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:30.557599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:30.557599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:30.557599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:30.563987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:30.563987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:30.563987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:30.563987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:30.563987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:30.563987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:30.563987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:30.563987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:30.563987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:30.563987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:30.563987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:30.563987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:30.563987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:30.563987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:30.563987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:30.563987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:30.563987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:30.565097 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:30.565097 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:30.565097 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:30.565097 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 279/559] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:30.565097 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741ba96-933e-4512-87f6-e4c871691cde None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:30.578314 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:30.592826 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76240bd6-5256-4be5-8f6c-d73db3316d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:30.593430 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76240bd6-5256-4be5-8f6c-d73db3316d66 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:30.593708 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76240bd6-5256-4be5-8f6c-d73db3316d66 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:30.593977 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76240bd6-5256-4be5-8f6c-d73db3316d66 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:30.601283 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76240bd6-5256-4be5-8f6c-d73db3316d66 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:30.602731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76240bd6-5256-4be5-8f6c-d73db3316d66 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:30.613558 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-76240bd6-5256-4be5-8f6c-d73db3316d66 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 00:14:30.613558 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:30.613558 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:30.613558 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:30.613558 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:30.613558 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:30.613558 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:30.613558 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:30.613558 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:30.613558 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:30.613558 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:30.613558 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:30.613558 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:14:30.613558 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:14:30.613558 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:14:30.613558 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:14:30.614574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:30.614574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:30.614574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:14:30.614574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:30.614574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:14:30.614574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:30.614574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:30.614574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:30.614574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:30.614574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:30.614574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:30.614574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:30.614574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:30.614574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:30.614574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:30.614574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:30.614574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:30.614574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:30.615966 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:30.615966 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:30.615966 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:14:30.615966 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:14:30.615966 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:14:30.615966 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:14:30.615966 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:14:30.615966 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:14:30.615966 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 00:14:30.615966 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:30.615966 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 281/560] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:30.615966 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76240bd6-5256-4be5-8f6c-d73db3316d66 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:30.645363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:30.670174 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741ba96-933e-4512-87f6-e4c871691cde None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:30.704432 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d12cf9-5e44-46d3-99f9-e2cd5c63b177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:30.705058 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d12cf9-5e44-46d3-99f9-e2cd5c63b177 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:30.705341 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d12cf9-5e44-46d3-99f9-e2cd5c63b177 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:30.705616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d12cf9-5e44-46d3-99f9-e2cd5c63b177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:30.716123 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d12cf9-5e44-46d3-99f9-e2cd5c63b177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:30.717854 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d12cf9-5e44-46d3-99f9-e2cd5c63b177 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:30.721441 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76240bd6-5256-4be5-8f6c-d73db3316d66 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:30.731933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-96d12cf9-5e44-46d3-99f9-e2cd5c63b177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:30.731933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:30.731933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:30.731933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:30.731933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:30.731933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:30.731933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:30.731933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:30.731933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:30.731933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:30.731933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:30.731933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:30.731933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:30.731933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:30.731933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:30.731933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:30.733034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:30.733034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:30.733034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:30.733034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:30.733034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:30.733034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:30.733034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:30.733034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:30.733034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:30.733034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:30.733034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:30.733034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:30.733034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:30.733034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:30.733034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:30.733034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:30.733034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:30.734121 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:30.734121 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:30.734121 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:30.734121 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 280/561] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:30.734121 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d12cf9-5e44-46d3-99f9-e2cd5c63b177 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:30.760160 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64290371-c9d7-472b-9a8d-119f5d8cbc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:30.760687 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64290371-c9d7-472b-9a8d-119f5d8cbc54 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:30.760970 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64290371-c9d7-472b-9a8d-119f5d8cbc54 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:30.761243 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64290371-c9d7-472b-9a8d-119f5d8cbc54 None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:30.761891 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64290371-c9d7-472b-9a8d-119f5d8cbc54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:30.762195 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64290371-c9d7-472b-9a8d-119f5d8cbc54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:30.764252 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64290371-c9d7-472b-9a8d-119f5d8cbc54 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:30.775829 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 282/562] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:30.776622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64290371-c9d7-472b-9a8d-119f5d8cbc54 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:30.820909 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:30.838142 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d12cf9-5e44-46d3-99f9-e2cd5c63b177 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:30.863853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:30.872472 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb8f8d-e40b-49ea-9a5e-f446c0c3c5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:30.873680 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb8f8d-e40b-49ea-9a5e-f446c0c3c5b3 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:30.873968 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb8f8d-e40b-49ea-9a5e-f446c0c3c5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:30.874241 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb8f8d-e40b-49ea-9a5e-f446c0c3c5b3 None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:30.874888 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb8f8d-e40b-49ea-9a5e-f446c0c3c5b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:30.875297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb8f8d-e40b-49ea-9a5e-f446c0c3c5b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:30.876695 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb8f8d-e40b-49ea-9a5e-f446c0c3c5b3 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:30.879222 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64290371-c9d7-472b-9a8d-119f5d8cbc54 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:30.888387 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 281/563] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:30.889022 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb8f8d-e40b-49ea-9a5e-f446c0c3c5b3 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:30.913746 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc53fbf-6517-4833-ba58-c16412c4be22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:30.914341 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc53fbf-6517-4833-ba58-c16412c4be22 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:30.914620 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc53fbf-6517-4833-ba58-c16412c4be22 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:30.914892 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc53fbf-6517-4833-ba58-c16412c4be22 None admin] PATH_INFO: `/v3/users` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:30.915805 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc53fbf-6517-4833-ba58-c16412c4be22 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:30.915939 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc53fbf-6517-4833-ba58-c16412c4be22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:30.917401 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc53fbf-6517-4833-ba58-c16412c4be22 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:30.934739 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 283/564] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 24 00:14:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:30.936105 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc53fbf-6517-4833-ba58-c16412c4be22 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:30.994128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb8f8d-e40b-49ea-9a5e-f446c0c3c5b3 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:31.029353 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b7dfc-41da-4d65-8a0d-23014c08c6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:31.030076 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b7dfc-41da-4d65-8a0d-23014c08c6bf None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:31.030381 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b7dfc-41da-4d65-8a0d-23014c08c6bf None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:31.030666 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b7dfc-41da-4d65-8a0d-23014c08c6bf None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:31.031363 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b7dfc-41da-4d65-8a0d-23014c08c6bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:31.031670 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b7dfc-41da-4d65-8a0d-23014c08c6bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:31.033061 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b7dfc-41da-4d65-8a0d-23014c08c6bf None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:31.034032 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:31.038135 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc53fbf-6517-4833-ba58-c16412c4be22 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:31.045300 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 282/565] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:31.046309 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b7dfc-41da-4d65-8a0d-23014c08c6bf None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:31.076903 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494f55f-6339-444a-9991-803d14e678d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:31.077517 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494f55f-6339-444a-9991-803d14e678d8 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:31.077792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494f55f-6339-444a-9991-803d14e678d8 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:31.078061 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494f55f-6339-444a-9991-803d14e678d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:31.084806 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494f55f-6339-444a-9991-803d14e678d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:31.086281 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494f55f-6339-444a-9991-803d14e678d8 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:31.094624 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:31.097408 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-b494f55f-6339-444a-9991-803d14e678d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:31.097408 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:31.097408 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:31.097408 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:31.097408 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:31.097408 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:31.097408 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:31.097408 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:31.097408 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:31.097408 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:31.097408 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:31.097408 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:31.097408 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:14:31.097408 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:14:31.097408 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:14:31.098490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:14:31.098490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:31.098490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:31.098490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:31.098490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:31.098490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:31.098490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:31.098490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:31.098490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:31.098490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:31.098490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:31.098490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:31.098490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:31.098490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:31.098490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:31.098490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:31.098490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:31.104679 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:14:31.104679 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:14:31.104679 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:14:31.104679 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:14:31.104679 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:14:31.104679 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:14:31.104679 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:31.104679 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:31.104679 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 284/566] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:31.104679 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494f55f-6339-444a-9991-803d14e678d8 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:31.152850 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b7dfc-41da-4d65-8a0d-23014c08c6bf None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:31.186595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e3786-56a2-4f5c-8d12-0d4d61ef4410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:31.187249 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e3786-56a2-4f5c-8d12-0d4d61ef4410 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:31.187525 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e3786-56a2-4f5c-8d12-0d4d61ef4410 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:31.187794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e3786-56a2-4f5c-8d12-0d4d61ef4410 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:31.195508 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e3786-56a2-4f5c-8d12-0d4d61ef4410 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:31.196982 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e3786-56a2-4f5c-8d12-0d4d61ef4410 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:31.199311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494f55f-6339-444a-9991-803d14e678d8 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:31.208023 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-cd6e3786-56a2-4f5c-8d12-0d4d61ef4410 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 00:14:31.208023 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:31.208023 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:31.208023 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:31.208023 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:31.208023 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:31.208023 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:31.208023 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:31.208023 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:31.208023 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:31.208023 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:31.208023 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:31.208023 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:14:31.208023 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:14:31.208023 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:14:31.208023 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:14:31.213938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:31.213938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:31.213938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:14:31.213938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:31.213938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:14:31.213938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:31.213938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:31.213938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:31.213938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:31.213938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:31.213938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:31.213938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:31.213938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:31.213938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:31.213938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:31.213938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:31.213938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:31.213938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:31.215220 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:31.215220 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:31.215220 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:14:31.215220 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:14:31.215220 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:14:31.215220 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:14:31.215220 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:14:31.215220 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:14:31.215220 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 00:14:31.215220 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:31.215220 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 283/567] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 00:14:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:31.215220 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e3786-56a2-4f5c-8d12-0d4d61ef4410 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:31.238764 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf94fb-19a8-43db-88b4-fee0e4abfbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:31.239780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf94fb-19a8-43db-88b4-fee0e4abfbf3 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:31.239780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf94fb-19a8-43db-88b4-fee0e4abfbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:31.240244 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf94fb-19a8-43db-88b4-fee0e4abfbf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:31.250167 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf94fb-19a8-43db-88b4-fee0e4abfbf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:31.251712 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf94fb-19a8-43db-88b4-fee0e4abfbf3 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:31.267562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-ffbf94fb-19a8-43db-88b4-fee0e4abfbf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:31.267562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:31.267562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:31.267562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:31.267562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:31.267562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:31.267562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:31.267562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:31.267562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:31.267562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:31.267562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:31.267562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:31.267562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:31.267562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:31.267562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:31.267562 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:31.273525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:31.273525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:31.273525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:31.273525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:31.273525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:31.273525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:31.273525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:31.273525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:31.273525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:31.273525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:31.273525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:31.273525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:31.273525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:31.273525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:31.273525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:31.273525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:31.273525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:31.274647 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:31.274647 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:31.274647 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:31.274647 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 285/568] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:31.274647 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf94fb-19a8-43db-88b4-fee0e4abfbf3 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:31.284458 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:31.320999 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e3786-56a2-4f5c-8d12-0d4d61ef4410 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:31.327907 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:31.355799 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644718d5-a544-47a8-b625-70cdbd954f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:31.356418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644718d5-a544-47a8-b625-70cdbd954f22 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:31.356703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644718d5-a544-47a8-b625-70cdbd954f22 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:31.356975 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644718d5-a544-47a8-b625-70cdbd954f22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:31.364207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644718d5-a544-47a8-b625-70cdbd954f22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:31.365662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644718d5-a544-47a8-b625-70cdbd954f22 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:31.372308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf94fb-19a8-43db-88b4-fee0e4abfbf3 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:31.376652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-644718d5-a544-47a8-b625-70cdbd954f22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:31.376652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:31.376652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:31.376652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:31.376652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:31.376652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:31.376652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:31.376652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:31.376652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:31.376652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:31.376652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:31.376652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:31.376652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:14:31.376652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:14:31.376652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:14:31.377668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:14:31.377668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:31.377668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:31.377668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:31.377668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:31.377668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:31.377668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:31.377668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:31.377668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:31.377668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:31.377668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:31.377668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:31.377668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:31.377668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:31.377668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:31.377668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:31.377668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:31.378745 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:14:31.378745 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:14:31.378745 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:14:31.378745 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:14:31.378745 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:14:31.378745 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:14:31.378745 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:31.378745 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:31.378745 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 284/569] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:31.379551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644718d5-a544-47a8-b625-70cdbd954f22 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:31.426270 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a601844-1e59-4c9e-85b7-fc58d8bfad77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:31.426875 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a601844-1e59-4c9e-85b7-fc58d8bfad77 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:31.427189 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a601844-1e59-4c9e-85b7-fc58d8bfad77 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:31.427768 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a601844-1e59-4c9e-85b7-fc58d8bfad77 None admin] PATH_INFO: `/v3/projects` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:31.428147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a601844-1e59-4c9e-85b7-fc58d8bfad77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:31.428458 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a601844-1e59-4c9e-85b7-fc58d8bfad77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:31.429899 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a601844-1e59-4c9e-85b7-fc58d8bfad77 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:31.442247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 286/570] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:14:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:31.443062 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a601844-1e59-4c9e-85b7-fc58d8bfad77 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:31.486967 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644718d5-a544-47a8-b625-70cdbd954f22 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:31.522260 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:31.526752 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756dc5c-183a-40b9-9599-ae5b2c6390bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:31.527384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756dc5c-183a-40b9-9599-ae5b2c6390bc None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:31.527722 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756dc5c-183a-40b9-9599-ae5b2c6390bc None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:31.527995 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756dc5c-183a-40b9-9599-ae5b2c6390bc None admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:31.528721 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756dc5c-183a-40b9-9599-ae5b2c6390bc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:31.529513 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756dc5c-183a-40b9-9599-ae5b2c6390bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:31.530942 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756dc5c-183a-40b9-9599-ae5b2c6390bc None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:31.548622 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 285/571] 10.222.0.42 () {56 vars in 1139 bytes} [Wed Aug 24 00:14:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:31.549349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756dc5c-183a-40b9-9599-ae5b2c6390bc None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:31.553984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a601844-1e59-4c9e-85b7-fc58d8bfad77 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:31.575657 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:31.588791 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfad15-4d34-4ce3-a396-823999d06b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:31.589385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfad15-4d34-4ce3-a396-823999d06b0b None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:31.589660 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfad15-4d34-4ce3-a396-823999d06b0b None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:31.589930 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfad15-4d34-4ce3-a396-823999d06b0b None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:31.590566 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfad15-4d34-4ce3-a396-823999d06b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:31.590865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfad15-4d34-4ce3-a396-823999d06b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:31.592802 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfad15-4d34-4ce3-a396-823999d06b0b None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:31.603890 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 287/572] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:31.604647 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfad15-4d34-4ce3-a396-823999d06b0b None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:31.652464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756dc5c-183a-40b9-9599-ae5b2c6390bc None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:31.686375 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c46939-c98a-4a6a-bbc6-07a1354e7d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:31.686962 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c46939-c98a-4a6a-bbc6-07a1354e7d7d None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:31.687267 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c46939-c98a-4a6a-bbc6-07a1354e7d7d None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:31.687534 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c46939-c98a-4a6a-bbc6-07a1354e7d7d None admin] PATH_INFO: `/v3/projects` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:31.688455 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c46939-c98a-4a6a-bbc6-07a1354e7d7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:31.688766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c46939-c98a-4a6a-bbc6-07a1354e7d7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:31.690182 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c46939-c98a-4a6a-bbc6-07a1354e7d7d None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:31.701828 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 286/573] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:14:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:31.702612 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c46939-c98a-4a6a-bbc6-07a1354e7d7d None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:31.714200 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfad15-4d34-4ce3-a396-823999d06b0b None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:31.744624 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:31.751220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57ee05-7255-420d-908f-82a7e924e2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:31.751873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57ee05-7255-420d-908f-82a7e924e2e5 None admin] REQUEST_METHOD: `PUT` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:31.752157 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57ee05-7255-420d-908f-82a7e924e2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:31.752431 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57ee05-7255-420d-908f-82a7e924e2e5 None admin] PATH_INFO: `/v3/projects/a63a68d37106431e80bd876cdce3e5fa/users/b588c52178934bce8cceff804a8f6e38/roles/85e127a1e1b348d6bf45890be6c68b1d` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:31.767354 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57ee05-7255-420d-908f-82a7e924e2e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a63a68d37106431e80bd876cdce3e5fa, user_id=b588c52178934bce8cceff804a8f6e38, role_id=85e127a1e1b348d6bf45890be6c68b1d)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:31.768810 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57ee05-7255-420d-908f-82a7e924e2e5 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:31.783592 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 288/574] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 00:14:31 2022] PUT /identity/v3/projects/a63a68d37106431e80bd876cdce3e5fa/users/b588c52178934bce8cceff804a8f6e38/roles/85e127a1e1b348d6bf45890be6c68b1d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:14:31.784418 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57ee05-7255-420d-908f-82a7e924e2e5 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:31.804095 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:31.822228 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c46939-c98a-4a6a-bbc6-07a1354e7d7d None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:31.860427 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe5b8f-0faf-4553-bc2b-ad7665c5c46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:31.861071 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe5b8f-0faf-4553-bc2b-ad7665c5c46e None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:31.861354 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe5b8f-0faf-4553-bc2b-ad7665c5c46e None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:31.861635 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe5b8f-0faf-4553-bc2b-ad7665c5c46e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:31.873305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe5b8f-0faf-4553-bc2b-ad7665c5c46e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:31.874816 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe5b8f-0faf-4553-bc2b-ad7665c5c46e None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:31.890874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-4afe5b8f-0faf-4553-bc2b-ad7665c5c46e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:31.890874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:31.890874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:31.890874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:31.890874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:31.890874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:31.890874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:31.890874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:31.890874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:31.890874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:31.890874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:31.890874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:31.890874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:31.890874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:31.890874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:31.890874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:31.891994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:31.891994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:31.891994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:31.891994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:31.891994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:31.891994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:31.891994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:31.891994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:31.891994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:31.891994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:31.891994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:31.891994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:31.891994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:31.891994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:31.891994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:31.891994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:31.891994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:31.892959 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:31.892959 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:31.892959 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:31.893626 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 287/575] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:31.894484 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe5b8f-0faf-4553-bc2b-ad7665c5c46e None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:31.907676 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57ee05-7255-420d-908f-82a7e924e2e5 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:31.947489 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3d8ca-8440-41ff-b48a-6c693c624b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:31.948137 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3d8ca-8440-41ff-b48a-6c693c624b5f None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:31.948417 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3d8ca-8440-41ff-b48a-6c693c624b5f None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:31.948694 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3d8ca-8440-41ff-b48a-6c693c624b5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:31.957142 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3d8ca-8440-41ff-b48a-6c693c624b5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:31.959818 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3d8ca-8440-41ff-b48a-6c693c624b5f None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:31.973662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-e4a3d8ca-8440-41ff-b48a-6c693c624b5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:31.973662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:31.973662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:31.973662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:31.973662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:31.973662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:31.973662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:31.973662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:31.973662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:31.973662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:31.973662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:31.973662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:31.973662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:14:31.973662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:14:31.973662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:14:31.974789 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:14:31.974789 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:31.974789 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:31.974789 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:31.974789 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:31.974789 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:31.974789 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:31.974789 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:31.974789 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:31.974789 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:31.974789 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:31.974789 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:31.974789 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:31.974789 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:31.974789 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:31.974789 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:31.974789 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:31.975926 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:14:31.975926 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:14:31.975926 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:14:31.975926 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:14:31.975926 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:14:31.975926 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:14:31.975926 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:31.975926 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:31.975926 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 289/576] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:31.976468 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3d8ca-8440-41ff-b48a-6c693c624b5f None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:32.011035 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe5b8f-0faf-4553-bc2b-ad7665c5c46e None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:32.023974 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:32.050284 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f140a1-54c5-408a-a82b-f24961d5a95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:32.050944 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f140a1-54c5-408a-a82b-f24961d5a95c None admin] REQUEST_METHOD: `PUT` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:32.051574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f140a1-54c5-408a-a82b-f24961d5a95c None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:32.051574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f140a1-54c5-408a-a82b-f24961d5a95c None admin] PATH_INFO: `/v3/projects/a63a68d37106431e80bd876cdce3e5fa/users/a863e95438d14892816e4f3c94673025/roles/85e127a1e1b348d6bf45890be6c68b1d` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:32.056657 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:32.070552 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f140a1-54c5-408a-a82b-f24961d5a95c None admin] RBAC: Authorizing `identity:create_grant(project_id=a63a68d37106431e80bd876cdce3e5fa, user_id=a863e95438d14892816e4f3c94673025, role_id=85e127a1e1b348d6bf45890be6c68b1d)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:32.072059 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f140a1-54c5-408a-a82b-f24961d5a95c None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:32.088223 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 288/577] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 00:14:31 2022] PUT /identity/v3/projects/a63a68d37106431e80bd876cdce3e5fa/users/a863e95438d14892816e4f3c94673025/roles/85e127a1e1b348d6bf45890be6c68b1d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:14:32.088466 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3d8ca-8440-41ff-b48a-6c693c624b5f None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:32.089043 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f140a1-54c5-408a-a82b-f24961d5a95c None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:32.131278 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a595f-3891-4ed3-8752-05a012626e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:32.132008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a595f-3891-4ed3-8752-05a012626e99 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:32.132481 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a595f-3891-4ed3-8752-05a012626e99 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:32.132761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a595f-3891-4ed3-8752-05a012626e99 None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:32.133521 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a595f-3891-4ed3-8752-05a012626e99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:32.133855 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a595f-3891-4ed3-8752-05a012626e99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:32.135692 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a595f-3891-4ed3-8752-05a012626e99 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:32.154030 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 290/578] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:32.155578 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a595f-3891-4ed3-8752-05a012626e99 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:32.231208 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f140a1-54c5-408a-a82b-f24961d5a95c None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:32.282877 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:32.287822 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a595f-3891-4ed3-8752-05a012626e99 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:32.301847 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3753543-4dfa-462b-b0bd-4c772d9574ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:32.302470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3753543-4dfa-462b-b0bd-4c772d9574ff None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:32.302748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3753543-4dfa-462b-b0bd-4c772d9574ff None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:32.303818 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3753543-4dfa-462b-b0bd-4c772d9574ff None admin] PATH_INFO: `/v3/projects` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:32.304570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3753543-4dfa-462b-b0bd-4c772d9574ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:32.304880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3753543-4dfa-462b-b0bd-4c772d9574ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:32.306468 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3753543-4dfa-462b-b0bd-4c772d9574ff None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:32.327203 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 289/579] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:14:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:32.330880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3753543-4dfa-462b-b0bd-4c772d9574ff None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:32.351428 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb6c30-8779-4aaa-a989-d2988a8bb512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:32.352091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb6c30-8779-4aaa-a989-d2988a8bb512 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:32.352352 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb6c30-8779-4aaa-a989-d2988a8bb512 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:32.352622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb6c30-8779-4aaa-a989-d2988a8bb512 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:32.362403 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb6c30-8779-4aaa-a989-d2988a8bb512 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:32.364456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb6c30-8779-4aaa-a989-d2988a8bb512 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:32.379144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-9cbb6c30-8779-4aaa-a989-d2988a8bb512 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:32.379144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:32.379144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:32.379144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:32.379144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:32.379144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:32.379144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:32.379144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:32.379144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:32.379144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:32.379144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:32.379144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:32.379144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:14:32.379144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:14:32.379144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:14:32.380091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:14:32.380091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:32.380091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:32.380091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:32.380091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:32.380091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:32.380091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:32.380091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:32.380091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:32.380091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:32.380091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:32.380091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:32.380091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:32.380091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:32.380091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:32.380091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:32.380091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:32.381292 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:14:32.381292 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:14:32.381292 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:14:32.381292 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:14:32.381292 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:14:32.381292 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:14:32.381292 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:32.381292 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:32.381292 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 291/580] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:32.386345 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb6c30-8779-4aaa-a989-d2988a8bb512 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:32.391592 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:32.453337 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3753543-4dfa-462b-b0bd-4c772d9574ff None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:32.496735 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091b061-e931-47ba-955d-0d46a266a2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:32.498356 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091b061-e931-47ba-955d-0d46a266a2f7 None admin] REQUEST_METHOD: `PUT` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:32.498836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091b061-e931-47ba-955d-0d46a266a2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:32.499282 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091b061-e931-47ba-955d-0d46a266a2f7 None admin] PATH_INFO: `/v3/projects/a63a68d37106431e80bd876cdce3e5fa/users/c43d7aa4ecfc4a598bbaa4f4fc4e4590/roles/85e127a1e1b348d6bf45890be6c68b1d` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:32.508720 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb6c30-8779-4aaa-a989-d2988a8bb512 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:32.526208 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091b061-e931-47ba-955d-0d46a266a2f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a63a68d37106431e80bd876cdce3e5fa, user_id=c43d7aa4ecfc4a598bbaa4f4fc4e4590, role_id=85e127a1e1b348d6bf45890be6c68b1d)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:32.527894 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091b061-e931-47ba-955d-0d46a266a2f7 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:32.555184 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 290/581] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 00:14:32 2022] PUT /identity/v3/projects/a63a68d37106431e80bd876cdce3e5fa/users/c43d7aa4ecfc4a598bbaa4f4fc4e4590/roles/85e127a1e1b348d6bf45890be6c68b1d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 00:14:32.587130 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb3fb8-620f-4aa7-9634-915960811327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:32.590931 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb3fb8-620f-4aa7-9634-915960811327 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:32.591409 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb3fb8-620f-4aa7-9634-915960811327 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:32.591848 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb3fb8-620f-4aa7-9634-915960811327 None admin] PATH_INFO: `/v3/projects` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:32.592705 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb3fb8-620f-4aa7-9634-915960811327 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:32.593690 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb3fb8-620f-4aa7-9634-915960811327 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:32.597591 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb3fb8-620f-4aa7-9634-915960811327 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:32.634553 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 292/582] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:14:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:32.642462 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091b061-e931-47ba-955d-0d46a266a2f7 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:32.818449 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:32.824692 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091b061-e931-47ba-955d-0d46a266a2f7 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:32.872737 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab7a95-90ef-40bb-a160-a63d3c2478d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:32.873580 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab7a95-90ef-40bb-a160-a63d3c2478d5 None admin] REQUEST_METHOD: `PUT` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:32.873987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab7a95-90ef-40bb-a160-a63d3c2478d5 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:32.874365 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab7a95-90ef-40bb-a160-a63d3c2478d5 None admin] PATH_INFO: `/v3/projects/a63a68d37106431e80bd876cdce3e5fa/users/ad894f6b3613401c88cd3b39d825e61d/roles/85e127a1e1b348d6bf45890be6c68b1d` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:32.891040 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab7a95-90ef-40bb-a160-a63d3c2478d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a63a68d37106431e80bd876cdce3e5fa, user_id=ad894f6b3613401c88cd3b39d825e61d, role_id=85e127a1e1b348d6bf45890be6c68b1d)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:32.892646 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab7a95-90ef-40bb-a160-a63d3c2478d5 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:32.919053 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 291/583] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 00:14:32 2022] PUT /identity/v3/projects/a63a68d37106431e80bd876cdce3e5fa/users/ad894f6b3613401c88cd3b39d825e61d/roles/85e127a1e1b348d6bf45890be6c68b1d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:14:34.172954 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6220ac-460f-4d6e-9a87-df4b226b589b None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:34.174004 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6220ac-460f-4d6e-9a87-df4b226b589b None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:34.174495 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6220ac-460f-4d6e-9a87-df4b226b589b None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:34.176069 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 293/584] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:34.181678 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2285647-5509-4eec-a37f-1bc2d8ef6d1f None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:34.182533 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2285647-5509-4eec-a37f-1bc2d8ef6d1f None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:34.183059 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2285647-5509-4eec-a37f-1bc2d8ef6d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:34.202719 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-f2285647-5509-4eec-a37f-1bc2d8ef6d1f None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:34.204239 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-f2285647-5509-4eec-a37f-1bc2d8ef6d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:34.285359 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 292/585] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:34.404564 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da46bd-b3ad-4e5e-bc8c-242316a0e2db None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:34.404973 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da46bd-b3ad-4e5e-bc8c-242316a0e2db None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:34.404973 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da46bd-b3ad-4e5e-bc8c-242316a0e2db None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:34.406556 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 294/586] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:34.412666 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c891b1-1e85-4eb6-b2d4-e160558afdc2 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:34.412666 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c891b1-1e85-4eb6-b2d4-e160558afdc2 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:34.412666 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c891b1-1e85-4eb6-b2d4-e160558afdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:34.432124 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-47c891b1-1e85-4eb6-b2d4-e160558afdc2 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:34.433237 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-47c891b1-1e85-4eb6-b2d4-e160558afdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:34.507027 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 293/587] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:34.633722 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da46bd-b3ad-4e5e-bc8c-242316a0e2db None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:34.657513 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:34.750960 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da46bd-b3ad-4e5e-bc8c-242316a0e2db None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:34.787598 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ec2a2-6d13-477c-8bd6-555e374ea32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:34.788244 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ec2a2-6d13-477c-8bd6-555e374ea32e None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:34.788525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ec2a2-6d13-477c-8bd6-555e374ea32e None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:34.788800 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ec2a2-6d13-477c-8bd6-555e374ea32e None admin] PATH_INFO: `/v3/roles/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:34.802084 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ec2a2-6d13-477c-8bd6-555e374ea32e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:34.807112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-c34ec2a2-6d13-477c-8bd6-555e374ea32e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:34.807112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:34.807112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:34.807112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:34.807112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:34.807112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:34.807112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:34.807112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:34.807112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:34.807112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:34.807112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:34.807112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:34.807112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:34.807112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:34.807112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:34.807112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:34.808163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:34.808163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:34.808163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:34.808163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:34.808163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:34.808163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:34.808163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:34.808163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:34.808163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:34.808163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:34.808163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:34.808163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:34.808163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:34.808163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:34.808163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:34.808163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:34.809253 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:34.809253 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:34.809253 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:34.809253 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:34.809253 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:34.809253 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:34.809253 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:34.809253 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:34.809253 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:34.809253 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:34.809253 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:34.809253 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:34.809253 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 295/588] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 00:14:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:34.818317 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c891b1-1e85-4eb6-b2d4-e160558afdc2 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:34.828009 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:34.842318 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ec2a2-6d13-477c-8bd6-555e374ea32e None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:34.926569 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c891b1-1e85-4eb6-b2d4-e160558afdc2 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:34.930465 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:34.952959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ec2a2-6d13-477c-8bd6-555e374ea32e None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:34.965930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb2c9c-4308-403f-ba0e-6c72b6a83707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:34.967382 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb2c9c-4308-403f-ba0e-6c72b6a83707 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:34.967876 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb2c9c-4308-403f-ba0e-6c72b6a83707 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:34.968384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb2c9c-4308-403f-ba0e-6c72b6a83707 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:34.969395 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb2c9c-4308-403f-ba0e-6c72b6a83707 None admin] RBAC: Adding query filter params (name=service) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:34.969891 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb2c9c-4308-403f-ba0e-6c72b6a83707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:34.971568 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb2c9c-4308-403f-ba0e-6c72b6a83707 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:34.985684 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 294/589] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 00:14:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:34.987343 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb2c9c-4308-403f-ba0e-6c72b6a83707 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:34.991756 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113aad6-4eae-4712-b9b4-cf747cd70e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:34.992490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113aad6-4eae-4712-b9b4-cf747cd70e1b None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:34.992838 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113aad6-4eae-4712-b9b4-cf747cd70e1b None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:34.993181 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113aad6-4eae-4712-b9b4-cf747cd70e1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:35.005302 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113aad6-4eae-4712-b9b4-cf747cd70e1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:35.010780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-e113aad6-4eae-4712-b9b4-cf747cd70e1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:35.010780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:35.010780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:35.010780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:35.010780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:35.010780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:35.010780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:35.010780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:35.010780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:35.010780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:35.010780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:35.010780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:35.010780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:35.010780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:35.010780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:35.010780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:35.012006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:35.012006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:35.012006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:35.012006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:35.012006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:35.012006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:35.012006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:35.012006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:35.012006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:35.012006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:35.012006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:35.012006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:35.012006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:35.012006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:35.012006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:35.012006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:35.013025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:35.013025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:35.013025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:35.013025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:35.013025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:35.013025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:35.013025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:35.013025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:35.013025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:35.013025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:35.013025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:35.013025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:35.018781 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 296/590] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 00:14:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:35.020097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56945645-3342-4933-84ea-c58cbfcd16db None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:35.020393 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56945645-3342-4933-84ea-c58cbfcd16db None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:35.020669 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56945645-3342-4933-84ea-c58cbfcd16db None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:35.026577 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 297/591] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:35.026577 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56945645-3342-4933-84ea-c58cbfcd16db None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:35.071872 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:35.115421 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb2c9c-4308-403f-ba0e-6c72b6a83707 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:35.134955 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56945645-3342-4933-84ea-c58cbfcd16db None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:35.153231 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eebfca-87de-4ce5-b47a-39e879743424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:35.154425 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eebfca-87de-4ce5-b47a-39e879743424 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:35.154711 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eebfca-87de-4ce5-b47a-39e879743424 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:35.154983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eebfca-87de-4ce5-b47a-39e879743424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:35.169251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eebfca-87de-4ce5-b47a-39e879743424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:35.171354 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35396281-9d52-48f6-a36f-36ea62956372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:35.171679 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eebfca-87de-4ce5-b47a-39e879743424 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:35.171952 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35396281-9d52-48f6-a36f-36ea62956372 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:35.172227 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35396281-9d52-48f6-a36f-36ea62956372 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:35.172494 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35396281-9d52-48f6-a36f-36ea62956372 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:35.173152 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35396281-9d52-48f6-a36f-36ea62956372 None admin] RBAC: Adding query filter params (name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:35.173690 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35396281-9d52-48f6-a36f-36ea62956372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:35.174819 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35396281-9d52-48f6-a36f-36ea62956372 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:35.183218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 298/592] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 00:14:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:35.184455 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24284a8b-9983-4c80-8810-2277df6ec4e3 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:35.184835 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24284a8b-9983-4c80-8810-2277df6ec4e3 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:35.185110 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24284a8b-9983-4c80-8810-2277df6ec4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:35.191823 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:35.193717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-b7eebfca-87de-4ce5-b47a-39e879743424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:35.193717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:35.193717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:35.193717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:35.193717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:35.193717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:35.193717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:35.193717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:35.193717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:35.193717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:35.193717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:35.193717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:35.193717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:35.193717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:35.193717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:35.193717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:35.196766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:35.196766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:35.196766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:35.196766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:35.196766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:35.196766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:35.196766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:35.196766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:35.196766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:35.196766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:35.196766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:35.196766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:35.196766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:35.196766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:35.196766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:35.196766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:35.196766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:35.197859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:35.197859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:35.197859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:35.197859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 295/593] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:35.197859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eebfca-87de-4ce5-b47a-39e879743424 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:35.211881 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-24284a8b-9983-4c80-8810-2277df6ec4e3 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:35.213112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-24284a8b-9983-4c80-8810-2277df6ec4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:35.281974 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 299/594] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:35.282819 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24284a8b-9983-4c80-8810-2277df6ec4e3 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:35.304325 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eebfca-87de-4ce5-b47a-39e879743424 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:35.326238 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:35.343127 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3341047-139c-47db-8e35-57a670191f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:35.343761 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3341047-139c-47db-8e35-57a670191f10 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:35.344039 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3341047-139c-47db-8e35-57a670191f10 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:35.344309 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3341047-139c-47db-8e35-57a670191f10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:35.355687 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3341047-139c-47db-8e35-57a670191f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:35.357711 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3341047-139c-47db-8e35-57a670191f10 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:35.371808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-a3341047-139c-47db-8e35-57a670191f10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:35.371808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:35.371808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:35.371808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:35.371808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:35.371808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:35.371808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:35.371808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:35.371808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:35.371808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:35.371808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:35.371808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:35.371808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:35.371808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:35.371808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:35.371808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:35.373005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:35.373005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:35.373005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:35.373005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:35.373005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:35.373005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:35.373005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:35.373005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:35.373005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:35.373005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:35.373005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:35.373005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:35.373005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:35.373005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:35.373005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:35.373005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:35.373005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:35.374104 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:35.374104 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:35.374104 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:35.377606 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 296/595] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:35.378823 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b5d2a-6429-410e-93c3-03b3cb2da153 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:35.379125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b5d2a-6429-410e-93c3-03b3cb2da153 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:35.379398 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b5d2a-6429-410e-93c3-03b3cb2da153 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:35.384890 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 297/596] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:35.384890 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b5d2a-6429-410e-93c3-03b3cb2da153 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:35.412301 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24284a8b-9983-4c80-8810-2277df6ec4e3 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:35.444710 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:35.452022 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c7f89-818d-42b8-a0ea-3b912e031df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:35.452619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c7f89-818d-42b8-a0ea-3b912e031df9 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:35.452894 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c7f89-818d-42b8-a0ea-3b912e031df9 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:35.453162 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c7f89-818d-42b8-a0ea-3b912e031df9 None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:35.453793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c7f89-818d-42b8-a0ea-3b912e031df9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:35.454092 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c7f89-818d-42b8-a0ea-3b912e031df9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:35.455499 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c7f89-818d-42b8-a0ea-3b912e031df9 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:35.473703 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 300/597] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:35.475073 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3c9ce-1868-4bad-933a-7f457e7962d2 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:35.475358 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3c9ce-1868-4bad-933a-7f457e7962d2 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:35.475627 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3c9ce-1868-4bad-933a-7f457e7962d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:35.493965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b5d2a-6429-410e-93c3-03b3cb2da153 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:35.494802 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-55b3c9ce-1868-4bad-933a-7f457e7962d2 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:35.496952 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-55b3c9ce-1868-4bad-933a-7f457e7962d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:35.539934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031f6e9-c85b-4962-a4bf-cac5d6286865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:35.540576 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031f6e9-c85b-4962-a4bf-cac5d6286865 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:35.540922 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031f6e9-c85b-4962-a4bf-cac5d6286865 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:35.541278 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031f6e9-c85b-4962-a4bf-cac5d6286865 None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:35.541930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031f6e9-c85b-4962-a4bf-cac5d6286865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:35.542239 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031f6e9-c85b-4962-a4bf-cac5d6286865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:35.543659 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031f6e9-c85b-4962-a4bf-cac5d6286865 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:35.556957 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 298/598] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:35.557768 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031f6e9-c85b-4962-a4bf-cac5d6286865 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:35.578951 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 301/599] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:35.579907 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3c9ce-1868-4bad-933a-7f457e7962d2 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:35.601247 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:35.688837 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3c9ce-1868-4bad-933a-7f457e7962d2 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:35.689060 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031f6e9-c85b-4962-a4bf-cac5d6286865 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:35.713799 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:35.727904 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececc9bb-000e-411a-abef-5ea3ce1f3b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:35.728695 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececc9bb-000e-411a-abef-5ea3ce1f3b1b None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:35.729029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececc9bb-000e-411a-abef-5ea3ce1f3b1b None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:35.729300 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececc9bb-000e-411a-abef-5ea3ce1f3b1b None admin] PATH_INFO: `/v3/users/nova` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:35.729874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65484a-7571-4a00-a63c-39f9041fb385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:35.730531 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65484a-7571-4a00-a63c-39f9041fb385 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:35.730811 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65484a-7571-4a00-a63c-39f9041fb385 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:35.731137 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65484a-7571-4a00-a63c-39f9041fb385 None admin] PATH_INFO: `/v3/users/glance` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:35.736797 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececc9bb-000e-411a-abef-5ea3ce1f3b1b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:35.738356 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececc9bb-000e-411a-abef-5ea3ce1f3b1b None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:35.739394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65484a-7571-4a00-a63c-39f9041fb385 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:35.740767 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65484a-7571-4a00-a63c-39f9041fb385 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:35.753560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-ad65484a-7571-4a00-a63c-39f9041fb385 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 00:14:35.753560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:35.753560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:35.753560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:35.753560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:35.753560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:35.753560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:35.753560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:35.753560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:35.753560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:35.753560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:35.753560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:35.753560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:14:35.753560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:14:35.753560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:14:35.753560 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:14:35.754570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:35.754570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:35.754570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:14:35.754570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:35.754570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:14:35.754570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:35.754570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:35.754570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:35.754570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:35.754570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:35.754570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:35.754570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:35.754570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:35.754570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:35.754570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:35.754570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:35.754570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:35.754570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:35.760619 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:35.760619 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:35.760619 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:14:35.760619 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:14:35.760619 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:14:35.760619 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:14:35.760619 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:14:35.760619 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:14:35.760619 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 00:14:35.760619 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:35.761186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-ececc9bb-000e-411a-abef-5ea3ce1f3b1b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:14:35.761186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:35.761186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:35.761186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:35.761186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:35.761186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:35.761186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:35.761186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:35.761186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:35.761186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:35.761186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:35.761186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:35.761186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:14:35.761186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:14:35.761186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:14:35.761186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:14:35.762040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:35.762040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:35.762040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:14:35.762040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:35.762040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:14:35.762040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:35.762040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:35.762040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:35.762040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:35.762040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:35.762040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:35.762040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:35.762040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:35.762040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:35.762040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:35.762040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:35.762040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:35.762040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:35.762963 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:35.762963 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:35.762963 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:14:35.762963 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:14:35.762963 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:14:35.762963 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:14:35.762963 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:14:35.762963 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:14:35.762963 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:14:35.762963 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:35.764163 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 299/600] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:35.764163 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65484a-7571-4a00-a63c-39f9041fb385 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:35.764317 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 302/601] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 24 00:14:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:35.764317 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececc9bb-000e-411a-abef-5ea3ce1f3b1b None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:35.869090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:35.872477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececc9bb-000e-411a-abef-5ea3ce1f3b1b None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:35.881032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65484a-7571-4a00-a63c-39f9041fb385 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:35.909687 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1554334-4ca8-4adb-b405-07286c03577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:35.910573 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1554334-4ca8-4adb-b405-07286c03577a None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:35.911021 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1554334-4ca8-4adb-b405-07286c03577a None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:35.911438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1554334-4ca8-4adb-b405-07286c03577a None admin] PATH_INFO: `/v3/users` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:35.912300 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1554334-4ca8-4adb-b405-07286c03577a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:35.912772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1554334-4ca8-4adb-b405-07286c03577a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:35.915109 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1554334-4ca8-4adb-b405-07286c03577a None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:35.916469 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c32fa-5867-4bee-84ec-8ec831ae34fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:35.917260 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c32fa-5867-4bee-84ec-8ec831ae34fd None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:35.917538 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c32fa-5867-4bee-84ec-8ec831ae34fd None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:35.918563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c32fa-5867-4bee-84ec-8ec831ae34fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:35.929356 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c32fa-5867-4bee-84ec-8ec831ae34fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:35.934451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-0c1c32fa-5867-4bee-84ec-8ec831ae34fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:35.934451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:35.934451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:35.934451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:35.934451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:35.934451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:35.934451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:35.934451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:35.934451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:35.934451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:35.934451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:35.934451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:35.934451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:35.934451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:35.934451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:35.934451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:35.935499 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:35.935499 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:35.935499 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:35.935499 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:35.935499 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:35.935499 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:35.935499 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:35.935499 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:35.935499 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:35.935499 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:35.935499 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:35.935499 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:35.935499 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:35.935499 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:35.935499 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:35.935499 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:35.936355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:35.936355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:35.936355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:35.936355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:35.936355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:35.936355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:35.936355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:35.936355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:35.936355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:35.936355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:35.936355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:35.936355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:35.936355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 300/602] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 00:14:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:35.937055 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c32fa-5867-4bee-84ec-8ec831ae34fd None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:35.940569 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 303/603] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 24 00:14:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:35.941129 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1554334-4ca8-4adb-b405-07286c03577a None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:35.981738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:36.042546 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c32fa-5867-4bee-84ec-8ec831ae34fd None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:36.042942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1554334-4ca8-4adb-b405-07286c03577a None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:36.076548 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72852c69-b6d4-4f47-9918-4997a7c7983e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:36.077138 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72852c69-b6d4-4f47-9918-4997a7c7983e None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:36.077414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72852c69-b6d4-4f47-9918-4997a7c7983e None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:36.077682 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72852c69-b6d4-4f47-9918-4997a7c7983e None admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:36.078402 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72852c69-b6d4-4f47-9918-4997a7c7983e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:36.078707 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72852c69-b6d4-4f47-9918-4997a7c7983e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:36.080189 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72852c69-b6d4-4f47-9918-4997a7c7983e None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:36.081041 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbeadd-e7a5-4320-b61e-a3151161129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:36.081664 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbeadd-e7a5-4320-b61e-a3151161129b None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:36.081942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbeadd-e7a5-4320-b61e-a3151161129b None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:36.082215 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbeadd-e7a5-4320-b61e-a3151161129b None admin] PATH_INFO: `/v3/roles/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:36.092632 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbeadd-e7a5-4320-b61e-a3151161129b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:36.097255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-79cbeadd-e7a5-4320-b61e-a3151161129b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:36.097255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:36.097255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:36.097255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:36.097255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:36.097255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:36.097255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:36.097255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:36.097255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:36.097255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:36.097255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:36.097255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:36.097255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:36.097255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:36.097255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:36.097255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:36.098206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:36.098206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:36.098206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:36.098206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:36.098206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:36.098206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:36.098206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:36.098206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:36.098206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:36.098206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:36.098206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:36.098206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:36.098206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:36.098206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:36.098206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:36.098206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:36.099843 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:36.099843 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:36.099843 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:36.099843 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:36.099843 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:36.099843 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:36.099843 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:36.099843 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:36.099843 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:36.099843 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:36.099843 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:14:36.099843 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:36.100487 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 301/604] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 24 00:14:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:36.100487 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72852c69-b6d4-4f47-9918-4997a7c7983e None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:36.100625 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 304/605] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 00:14:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:36.100625 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbeadd-e7a5-4320-b61e-a3151161129b None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:36.115119 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:36.202514 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72852c69-b6d4-4f47-9918-4997a7c7983e None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:36.205208 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:36.208522 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbeadd-e7a5-4320-b61e-a3151161129b None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:36.238221 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c21b14-5572-48b5-a424-70ad0395c5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:36.238823 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c21b14-5572-48b5-a424-70ad0395c5ae None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:36.239193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c21b14-5572-48b5-a424-70ad0395c5ae None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:36.239470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c21b14-5572-48b5-a424-70ad0395c5ae None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:36.240138 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c21b14-5572-48b5-a424-70ad0395c5ae None admin] RBAC: Adding query filter params (name=service) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:36.240499 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c21b14-5572-48b5-a424-70ad0395c5ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:36.241871 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c21b14-5572-48b5-a424-70ad0395c5ae None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:36.243592 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8a751-5b7f-4fbb-a9ca-601cc060f069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:36.244501 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8a751-5b7f-4fbb-a9ca-601cc060f069 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:36.244778 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8a751-5b7f-4fbb-a9ca-601cc060f069 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:36.245049 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8a751-5b7f-4fbb-a9ca-601cc060f069 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:36.250234 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 302/606] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 00:14:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:36.251158 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c21b14-5572-48b5-a424-70ad0395c5ae None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:36.323722 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8a751-5b7f-4fbb-a9ca-601cc060f069 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:36.325175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8a751-5b7f-4fbb-a9ca-601cc060f069 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:36.326331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:36.355376 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c21b14-5572-48b5-a424-70ad0395c5ae None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:36.389030 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bf08d-db0a-4fec-8c5e-488a6f12bd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:36.389623 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bf08d-db0a-4fec-8c5e-488a6f12bd5e None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:36.389903 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bf08d-db0a-4fec-8c5e-488a6f12bd5e None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:36.390175 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bf08d-db0a-4fec-8c5e-488a6f12bd5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:36.424656 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:36.428870 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 305/607] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:36.429873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8a751-5b7f-4fbb-a9ca-601cc060f069 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:36.457925 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bf08d-db0a-4fec-8c5e-488a6f12bd5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:36.459345 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bf08d-db0a-4fec-8c5e-488a6f12bd5e None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:36.531262 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:36.533172 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8a751-5b7f-4fbb-a9ca-601cc060f069 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:36.563944 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 303/608] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:36.564897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bf08d-db0a-4fec-8c5e-488a6f12bd5e None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:36.570670 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d8fc7-68a3-4779-83bd-181c2be8009b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:36.571315 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d8fc7-68a3-4779-83bd-181c2be8009b None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:36.571593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d8fc7-68a3-4779-83bd-181c2be8009b None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:36.571861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d8fc7-68a3-4779-83bd-181c2be8009b None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:36.572514 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d8fc7-68a3-4779-83bd-181c2be8009b None admin] RBAC: Adding query filter params (name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:36.572812 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d8fc7-68a3-4779-83bd-181c2be8009b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:36.574191 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d8fc7-68a3-4779-83bd-181c2be8009b None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:36.582795 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 306/609] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 00:14:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:36.583614 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d8fc7-68a3-4779-83bd-181c2be8009b None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:36.652596 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:36.673954 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bf08d-db0a-4fec-8c5e-488a6f12bd5e None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:36.697060 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d8fc7-68a3-4779-83bd-181c2be8009b None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:36.708820 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc54b5-5717-4c92-82f8-e178b65e3bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:36.709373 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc54b5-5717-4c92-82f8-e178b65e3bed None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:36.709650 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc54b5-5717-4c92-82f8-e178b65e3bed None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:36.709921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc54b5-5717-4c92-82f8-e178b65e3bed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:36.720040 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc54b5-5717-4c92-82f8-e178b65e3bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:36.721482 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc54b5-5717-4c92-82f8-e178b65e3bed None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:36.731309 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282744ec-1243-4988-96aa-99661989e1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:36.731946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282744ec-1243-4988-96aa-99661989e1e6 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:36.732222 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282744ec-1243-4988-96aa-99661989e1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:36.732492 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282744ec-1243-4988-96aa-99661989e1e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:36.736084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-befc54b5-5717-4c92-82f8-e178b65e3bed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:36.736084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:36.736084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:36.736084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:36.736084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:36.736084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:36.736084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:36.736084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:36.736084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:36.736084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:36.736084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:36.736084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:36.736084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:36.736084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:36.736084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:36.736084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:36.737147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:36.737147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:36.737147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:36.737147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:36.737147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:36.737147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:36.737147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:36.737147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:36.737147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:36.737147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:36.737147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:36.737147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:36.737147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:36.737147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:36.737147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:36.737147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:36.737147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:36.738029 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:36.738029 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:36.738029 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:36.738029 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 304/610] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:36.738029 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc54b5-5717-4c92-82f8-e178b65e3bed None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:36.745361 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282744ec-1243-4988-96aa-99661989e1e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:36.746799 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282744ec-1243-4988-96aa-99661989e1e6 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:36.762052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-282744ec-1243-4988-96aa-99661989e1e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:36.762052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:36.762052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:36.762052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:36.762052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:36.762052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:36.762052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:36.762052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:36.762052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:36.762052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:36.762052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:36.762052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:36.762052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:36.762052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:36.762052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:36.762052 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:36.763293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:36.763293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:36.763293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:36.763293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:36.763293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:36.763293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:36.763293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:36.763293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:36.763293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:36.763293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:36.763293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:36.763293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:36.763293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:36.763293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:36.763293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:36.763293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:36.763293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:36.764904 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:36.764904 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:36.764904 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:36.764904 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 307/611] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:36.764904 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282744ec-1243-4988-96aa-99661989e1e6 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:36.771888 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:36.849378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc54b5-5717-4c92-82f8-e178b65e3bed None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:36.867141 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282744ec-1243-4988-96aa-99661989e1e6 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:36.881426 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:36.883748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f920c-caf2-474d-b388-c06ebe06856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:36.884453 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f920c-caf2-474d-b388-c06ebe06856e None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:36.884741 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f920c-caf2-474d-b388-c06ebe06856e None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:36.885007 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f920c-caf2-474d-b388-c06ebe06856e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:36.895915 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f920c-caf2-474d-b388-c06ebe06856e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:36.897381 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f920c-caf2-474d-b388-c06ebe06856e None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:36.901790 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bd0a9-2e8a-4ffd-bd64-39dc6a13feb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:36.902400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bd0a9-2e8a-4ffd-bd64-39dc6a13feb0 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:36.902675 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bd0a9-2e8a-4ffd-bd64-39dc6a13feb0 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:36.902943 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bd0a9-2e8a-4ffd-bd64-39dc6a13feb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:36.910978 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-a40f920c-caf2-474d-b388-c06ebe06856e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:36.910978 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:36.910978 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:36.910978 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:36.910978 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:36.910978 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:36.910978 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:36.910978 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:36.910978 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:36.910978 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:36.910978 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:36.910978 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:36.910978 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:36.910978 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:36.910978 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:36.910978 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:36.912122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:36.912122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:36.912122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:36.912122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:36.912122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:36.912122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:36.912122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:36.912122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:36.912122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:36.912122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:36.912122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:36.912122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:36.912122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:36.912122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:36.912122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:36.912122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:36.912122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:36.913202 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:36.913202 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:36.913202 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:36.914064 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07bd0a9-2e8a-4ffd-bd64-39dc6a13feb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:36.915134 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 305/612] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:36.915726 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07bd0a9-2e8a-4ffd-bd64-39dc6a13feb0 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:36.916078 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f920c-caf2-474d-b388-c06ebe06856e None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:36.930196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-b07bd0a9-2e8a-4ffd-bd64-39dc6a13feb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:36.930196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:36.930196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:36.930196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:36.930196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:36.930196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:36.930196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:36.930196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:36.930196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:36.930196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:36.930196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:36.930196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:36.930196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:36.930196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:36.930196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:36.930196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:36.931367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:36.931367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:36.931367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:36.931367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:36.931367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:36.931367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:36.931367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:36.931367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:36.931367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:36.931367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:36.931367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:36.931367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:36.931367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:36.931367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:36.931367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:36.931367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:36.931367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:36.932264 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:36.932264 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:36.932264 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:36.932264 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 308/613] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:36.932484 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bd0a9-2e8a-4ffd-bd64-39dc6a13feb0 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:37.003285 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:37.028570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f920c-caf2-474d-b388-c06ebe06856e None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:37.036309 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bd0a9-2e8a-4ffd-bd64-39dc6a13feb0 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:37.063445 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed67df5-afca-4763-aa0e-1ca40ef98ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:37.064041 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed67df5-afca-4763-aa0e-1ca40ef98ce7 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:37.064320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed67df5-afca-4763-aa0e-1ca40ef98ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:37.064589 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed67df5-afca-4763-aa0e-1ca40ef98ce7 None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:37.065340 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed67df5-afca-4763-aa0e-1ca40ef98ce7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:37.065652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed67df5-afca-4763-aa0e-1ca40ef98ce7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:37.067030 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed67df5-afca-4763-aa0e-1ca40ef98ce7 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:37.071242 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987e91b-d0e3-4db2-99d4-8d75c2df2482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:37.071851 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987e91b-d0e3-4db2-99d4-8d75c2df2482 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:37.072134 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987e91b-d0e3-4db2-99d4-8d75c2df2482 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:37.072466 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987e91b-d0e3-4db2-99d4-8d75c2df2482 None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:37.073035 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987e91b-d0e3-4db2-99d4-8d75c2df2482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:37.073339 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987e91b-d0e3-4db2-99d4-8d75c2df2482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:37.074731 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987e91b-d0e3-4db2-99d4-8d75c2df2482 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:37.082167 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 306/614] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:37.083573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed67df5-afca-4763-aa0e-1ca40ef98ce7 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:37.087430 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 309/615] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:37.088239 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987e91b-d0e3-4db2-99d4-8d75c2df2482 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:37.117891 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:37.187758 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed67df5-afca-4763-aa0e-1ca40ef98ce7 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:37.194894 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987e91b-d0e3-4db2-99d4-8d75c2df2482 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:37.223343 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2614e45-a1db-49d3-8808-d272492f2586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:37.223952 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2614e45-a1db-49d3-8808-d272492f2586 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:37.224235 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2614e45-a1db-49d3-8808-d272492f2586 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:37.224514 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2614e45-a1db-49d3-8808-d272492f2586 None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:37.225154 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2614e45-a1db-49d3-8808-d272492f2586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:37.225463 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2614e45-a1db-49d3-8808-d272492f2586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:37.226842 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2614e45-a1db-49d3-8808-d272492f2586 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:37.229170 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:37.230420 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe1d39-2bb7-4804-bda3-abfbf388e64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:37.231053 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe1d39-2bb7-4804-bda3-abfbf388e64c None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:37.231340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe1d39-2bb7-4804-bda3-abfbf388e64c None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:37.231615 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe1d39-2bb7-4804-bda3-abfbf388e64c None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:37.232853 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe1d39-2bb7-4804-bda3-abfbf388e64c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:37.233159 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe1d39-2bb7-4804-bda3-abfbf388e64c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:37.234550 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe1d39-2bb7-4804-bda3-abfbf388e64c None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:37.239722 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 307/616] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:37.240545 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2614e45-a1db-49d3-8808-d272492f2586 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:37.246216 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 310/617] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:37.247811 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe1d39-2bb7-4804-bda3-abfbf388e64c None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:37.338304 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:37.350820 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2614e45-a1db-49d3-8808-d272492f2586 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:37.357356 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe1d39-2bb7-4804-bda3-abfbf388e64c None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:37.386559 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582db1dd-7ad3-467b-8989-81ad334bb8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:37.387209 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582db1dd-7ad3-467b-8989-81ad334bb8f5 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:37.387487 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582db1dd-7ad3-467b-8989-81ad334bb8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:37.387755 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582db1dd-7ad3-467b-8989-81ad334bb8f5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:37.391387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594b64a-c056-4cd9-9be5-e6f7acf69ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:37.392003 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594b64a-c056-4cd9-9be5-e6f7acf69ae5 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:37.392279 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594b64a-c056-4cd9-9be5-e6f7acf69ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:37.392551 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594b64a-c056-4cd9-9be5-e6f7acf69ae5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:37.395732 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582db1dd-7ad3-467b-8989-81ad334bb8f5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:37.397163 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582db1dd-7ad3-467b-8989-81ad334bb8f5 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:37.398982 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594b64a-c056-4cd9-9be5-e6f7acf69ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:37.401036 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594b64a-c056-4cd9-9be5-e6f7acf69ae5 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:37.409168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-582db1dd-7ad3-467b-8989-81ad334bb8f5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 00:14:37.409168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:37.409168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:37.409168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:37.409168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:37.409168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:37.409168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:37.409168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:37.409168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:37.409168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:37.409168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:37.409168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:37.409168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:14:37.409168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:14:37.409168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:14:37.409168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:14:37.410135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:37.410135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:37.410135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:14:37.410135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:37.410135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:14:37.410135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:37.410135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:37.410135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:37.410135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:37.410135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:37.410135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:37.410135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:37.410135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:37.410135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:37.410135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:37.410135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:37.410135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:37.410135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:37.411117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:37.411117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:37.411117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:14:37.411117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:14:37.411117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:14:37.411117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:14:37.411117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:14:37.411117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:14:37.411117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 00:14:37.411117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:37.411117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 308/618] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:37.411117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582db1dd-7ad3-467b-8989-81ad334bb8f5 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:37.420381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-d594b64a-c056-4cd9-9be5-e6f7acf69ae5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:37.420381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:37.420381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:37.420381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:37.420381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:37.420381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:37.420381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:37.420381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:37.420381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:37.420381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:37.420381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:37.420381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:37.420381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:14:37.420381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:14:37.420381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:14:37.421395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:14:37.421395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:37.421395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:37.421395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:37.421395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:37.421395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:37.421395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:37.421395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:37.421395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:37.421395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:37.421395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:37.421395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:37.421395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:37.421395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:37.421395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:37.421395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:37.421395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:37.423198 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:14:37.423198 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:14:37.423198 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:14:37.423198 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:14:37.423198 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:14:37.423198 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:14:37.423198 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:37.423198 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:37.423198 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 311/619] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:37.423198 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594b64a-c056-4cd9-9be5-e6f7acf69ae5 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:37.470798 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:37.523419 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582db1dd-7ad3-467b-8989-81ad334bb8f5 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:37.532729 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594b64a-c056-4cd9-9be5-e6f7acf69ae5 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:37.558136 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b20d60-a819-4384-85d1-ef009df5cb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:37.558760 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b20d60-a819-4384-85d1-ef009df5cb93 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:37.559071 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b20d60-a819-4384-85d1-ef009df5cb93 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:37.559348 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b20d60-a819-4384-85d1-ef009df5cb93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:37.567220 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b20d60-a819-4384-85d1-ef009df5cb93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:37.567387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377120c-c26e-4515-b14a-34d32411f5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:37.567959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377120c-c26e-4515-b14a-34d32411f5f4 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:37.568235 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377120c-c26e-4515-b14a-34d32411f5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:37.568504 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377120c-c26e-4515-b14a-34d32411f5f4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:37.568687 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b20d60-a819-4384-85d1-ef009df5cb93 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:37.576702 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377120c-c26e-4515-b14a-34d32411f5f4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:37.578129 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377120c-c26e-4515-b14a-34d32411f5f4 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:37.580799 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-96b20d60-a819-4384-85d1-ef009df5cb93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:37.580799 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:37.580799 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:37.580799 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:37.580799 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:37.580799 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:37.580799 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:37.580799 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:37.580799 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:37.580799 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:37.580799 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:37.580799 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:37.580799 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:14:37.580799 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:14:37.580799 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:14:37.581863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:14:37.581863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:37.581863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:37.581863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:37.581863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:37.581863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:37.581863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:37.581863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:37.581863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:37.581863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:37.581863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:37.581863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:37.581863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:37.581863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:37.581863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:37.581863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:37.581863 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:37.582953 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:14:37.582953 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:14:37.582953 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:14:37.582953 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:14:37.582953 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:14:37.582953 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:14:37.582953 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:37.582953 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:37.582953 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 309/620] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:37.582953 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b20d60-a819-4384-85d1-ef009df5cb93 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:37.589957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-6377120c-c26e-4515-b14a-34d32411f5f4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 00:14:37.589957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:37.589957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:37.589957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:37.589957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:37.589957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:37.589957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:37.589957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:37.589957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:37.589957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:37.589957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:37.589957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:37.589957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:14:37.589957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:14:37.589957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:14:37.589957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:14:37.591085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:37.591085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:37.591085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:14:37.591085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:37.591085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:14:37.591085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:37.591085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:37.591085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:37.591085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:37.591085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:37.591085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:37.591085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:37.591085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:37.591085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:37.591085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:37.591085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:37.591085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:37.591085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:37.592185 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:37.592185 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:37.592185 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:14:37.592185 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:14:37.592185 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:14:37.592185 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:14:37.592185 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:14:37.592185 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:14:37.592185 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 00:14:37.592185 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:37.592185 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 312/621] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 00:14:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:37.592185 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377120c-c26e-4515-b14a-34d32411f5f4 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:37.603997 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:37.696967 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b20d60-a819-4384-85d1-ef009df5cb93 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:37.704303 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377120c-c26e-4515-b14a-34d32411f5f4 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:37.712541 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:37.730123 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc8c3e-22c6-4356-8ef9-819a7455e2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:37.730718 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc8c3e-22c6-4356-8ef9-819a7455e2ad None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:37.731009 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc8c3e-22c6-4356-8ef9-819a7455e2ad None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:37.731294 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc8c3e-22c6-4356-8ef9-819a7455e2ad None admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:37.732544 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc8c3e-22c6-4356-8ef9-819a7455e2ad None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:37.732843 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc8c3e-22c6-4356-8ef9-819a7455e2ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:37.734419 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc8c3e-22c6-4356-8ef9-819a7455e2ad None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:37.738808 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1c85b-3351-40be-98bb-4207661be87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:37.739434 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1c85b-3351-40be-98bb-4207661be87e None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:37.739711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1c85b-3351-40be-98bb-4207661be87e None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:37.739977 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1c85b-3351-40be-98bb-4207661be87e None admin] PATH_INFO: `/v3/projects` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:37.740657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1c85b-3351-40be-98bb-4207661be87e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:37.740955 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1c85b-3351-40be-98bb-4207661be87e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:37.742371 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1c85b-3351-40be-98bb-4207661be87e None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:37.755884 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 310/622] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 24 00:14:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:37.756048 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 313/623] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:14:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:37.756586 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1c85b-3351-40be-98bb-4207661be87e None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:37.756675 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc8c3e-22c6-4356-8ef9-819a7455e2ad None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:37.822781 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:37.857806 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1c85b-3351-40be-98bb-4207661be87e None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:37.868554 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc8c3e-22c6-4356-8ef9-819a7455e2ad None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:37.892374 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef846d-422e-4949-8030-e7745600574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:37.892967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef846d-422e-4949-8030-e7745600574b None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:37.893244 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef846d-422e-4949-8030-e7745600574b None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:37.893509 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef846d-422e-4949-8030-e7745600574b None admin] PATH_INFO: `/v3/users` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:37.894226 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef846d-422e-4949-8030-e7745600574b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:37.894551 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef846d-422e-4949-8030-e7745600574b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:37.896007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef846d-422e-4949-8030-e7745600574b None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:37.904444 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4a1be-d157-488f-85b8-616440958d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:37.905036 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4a1be-d157-488f-85b8-616440958d23 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:37.905312 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4a1be-d157-488f-85b8-616440958d23 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:37.905579 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4a1be-d157-488f-85b8-616440958d23 None admin] PATH_INFO: `/v3/projects` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:37.906257 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4a1be-d157-488f-85b8-616440958d23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:37.906559 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4a1be-d157-488f-85b8-616440958d23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:37.907995 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4a1be-d157-488f-85b8-616440958d23 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:37.913998 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 314/624] 10.222.0.42 () {56 vars in 1139 bytes} [Wed Aug 24 00:14:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:37.915069 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef846d-422e-4949-8030-e7745600574b None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:37.920019 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 311/625] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:14:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:37.920817 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4a1be-d157-488f-85b8-616440958d23 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:37.958022 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:38.014698 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef846d-422e-4949-8030-e7745600574b None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:38.023634 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4a1be-d157-488f-85b8-616440958d23 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:38.038922 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:38.051035 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9254294-3bb3-4bfd-83e1-02d1925af993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:38.051648 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9254294-3bb3-4bfd-83e1-02d1925af993 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:38.051923 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9254294-3bb3-4bfd-83e1-02d1925af993 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:38.052270 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9254294-3bb3-4bfd-83e1-02d1925af993 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:38.059575 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91513c2c-a3fc-44dc-89b1-2387b3862944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:38.060206 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91513c2c-a3fc-44dc-89b1-2387b3862944 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:38.060482 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91513c2c-a3fc-44dc-89b1-2387b3862944 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:38.060749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91513c2c-a3fc-44dc-89b1-2387b3862944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:38.061462 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91513c2c-a3fc-44dc-89b1-2387b3862944 None admin] RBAC: Adding query filter params (role.id=85e127a1e1b348d6bf45890be6c68b1d, scope.project.id=a63a68d37106431e80bd876cdce3e5fa, user.id=a863e95438d14892816e4f3c94673025) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:38.061766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91513c2c-a3fc-44dc-89b1-2387b3862944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:38.063522 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91513c2c-a3fc-44dc-89b1-2387b3862944 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:38.086657 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 312/626] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:14:37 2022] GET /identity/v3/role_assignments?user.id=a863e95438d14892816e4f3c94673025&scope.project.id=a63a68d37106431e80bd876cdce3e5fa&role.id=85e127a1e1b348d6bf45890be6c68b1d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:38.086657 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91513c2c-a3fc-44dc-89b1-2387b3862944 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:38.127076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9254294-3bb3-4bfd-83e1-02d1925af993 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:38.128510 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9254294-3bb3-4bfd-83e1-02d1925af993 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:38.191453 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:38.196563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91513c2c-a3fc-44dc-89b1-2387b3862944 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:38.240239 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe649e-c930-484a-8583-2d3c7d9d5bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:38.241647 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe649e-c930-484a-8583-2d3c7d9d5bb2 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:38.242133 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe649e-c930-484a-8583-2d3c7d9d5bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:38.243330 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe649e-c930-484a-8583-2d3c7d9d5bb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:38.250444 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 315/627] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:38.251325 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9254294-3bb3-4bfd-83e1-02d1925af993 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:38.283636 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:38.325738 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe649e-c930-484a-8583-2d3c7d9d5bb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:38.327289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe649e-c930-484a-8583-2d3c7d9d5bb2 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:38.372450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9254294-3bb3-4bfd-83e1-02d1925af993 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:38.432209 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db064718-9818-4561-b099-7eaf82a4fbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:38.432737 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db064718-9818-4561-b099-7eaf82a4fbc9 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:38.433021 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db064718-9818-4561-b099-7eaf82a4fbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:38.433296 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db064718-9818-4561-b099-7eaf82a4fbc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:38.434032 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db064718-9818-4561-b099-7eaf82a4fbc9 None admin] RBAC: Adding query filter params (role.id=85e127a1e1b348d6bf45890be6c68b1d, scope.project.id=a63a68d37106431e80bd876cdce3e5fa, user.id=b588c52178934bce8cceff804a8f6e38) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:38.434346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db064718-9818-4561-b099-7eaf82a4fbc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:38.435880 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db064718-9818-4561-b099-7eaf82a4fbc9 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:38.445864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 316/628] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:14:38 2022] GET /identity/v3/role_assignments?user.id=b588c52178934bce8cceff804a8f6e38&scope.project.id=a63a68d37106431e80bd876cdce3e5fa&role.id=85e127a1e1b348d6bf45890be6c68b1d => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:38.447370 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db064718-9818-4561-b099-7eaf82a4fbc9 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:38.452092 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:38.480460 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 313/629] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:38.488466 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe649e-c930-484a-8583-2d3c7d9d5bb2 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:38.656518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe649e-c930-484a-8583-2d3c7d9d5bb2 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:38.673137 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:38.694699 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db064718-9818-4561-b099-7eaf82a4fbc9 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:38.712261 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6d773-d3af-45a0-b1b7-af81c5cf79e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:38.712901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6d773-d3af-45a0-b1b7-af81c5cf79e1 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:38.713182 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6d773-d3af-45a0-b1b7-af81c5cf79e1 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:38.713455 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6d773-d3af-45a0-b1b7-af81c5cf79e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:38.727986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6d773-d3af-45a0-b1b7-af81c5cf79e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:38.729473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6d773-d3af-45a0-b1b7-af81c5cf79e1 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:38.738467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155cd94-604d-44ff-9316-fd77acddb207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:38.739503 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155cd94-604d-44ff-9316-fd77acddb207 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:38.740183 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155cd94-604d-44ff-9316-fd77acddb207 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:38.740687 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155cd94-604d-44ff-9316-fd77acddb207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:38.745331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-04f6d773-d3af-45a0-b1b7-af81c5cf79e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:38.745331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:38.745331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:38.745331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:38.745331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:38.745331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:38.745331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:38.745331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:38.745331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:38.745331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:38.745331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:38.745331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:38.745331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:38.745331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:38.745331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:38.745331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:38.746297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:38.746297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:38.746297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:38.746297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:38.746297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:38.746297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:38.746297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:38.746297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:38.746297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:38.746297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:38.746297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:38.746297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:38.746297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:38.746297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:38.746297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:38.746297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:38.746297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:38.747241 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:38.747241 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:38.747241 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:38.747241 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 314/630] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:38.755518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6d773-d3af-45a0-b1b7-af81c5cf79e1 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:38.755937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155cd94-604d-44ff-9316-fd77acddb207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:38.759025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155cd94-604d-44ff-9316-fd77acddb207 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:38.773921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-9155cd94-604d-44ff-9316-fd77acddb207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:38.773921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:38.773921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:38.773921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:38.773921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:38.773921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:38.773921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:38.773921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:38.773921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:38.773921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:38.773921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:38.773921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:38.773921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:38.773921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:38.773921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:38.773921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:38.774920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:38.774920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:38.774920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:38.774920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:38.774920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:38.774920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:38.774920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:38.774920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:38.774920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:38.774920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:38.774920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:38.774920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:38.774920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:38.774920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:38.774920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:38.774920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:38.774920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:38.775876 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:38.775876 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:38.775876 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:38.775876 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 317/631] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:38.780875 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155cd94-604d-44ff-9316-fd77acddb207 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:38.823815 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:38.898690 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6d773-d3af-45a0-b1b7-af81c5cf79e1 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:38.914218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155cd94-604d-44ff-9316-fd77acddb207 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:38.936275 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec2051-13ed-4b4b-9dc3-da823d8e77b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:38.936890 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec2051-13ed-4b4b-9dc3-da823d8e77b3 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:38.937173 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec2051-13ed-4b4b-9dc3-da823d8e77b3 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:38.937447 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec2051-13ed-4b4b-9dc3-da823d8e77b3 None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:38.938514 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec2051-13ed-4b4b-9dc3-da823d8e77b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:38.938636 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec2051-13ed-4b4b-9dc3-da823d8e77b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:38.940065 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec2051-13ed-4b4b-9dc3-da823d8e77b3 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:38.953681 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 315/632] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:38.958583 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec2051-13ed-4b4b-9dc3-da823d8e77b3 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:38.964117 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da81415-b9e7-4010-8174-a0b18b101058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:38.965022 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da81415-b9e7-4010-8174-a0b18b101058 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:38.965510 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da81415-b9e7-4010-8174-a0b18b101058 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:38.966003 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da81415-b9e7-4010-8174-a0b18b101058 None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:38.966901 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da81415-b9e7-4010-8174-a0b18b101058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:38.967430 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da81415-b9e7-4010-8174-a0b18b101058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:38.969513 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da81415-b9e7-4010-8174-a0b18b101058 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:38.982256 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:38.990954 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 318/633] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:38.992380 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da81415-b9e7-4010-8174-a0b18b101058 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:39.091947 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec2051-13ed-4b4b-9dc3-da823d8e77b3 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:39.104606 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:39.125944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da81415-b9e7-4010-8174-a0b18b101058 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:39.132726 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c60ddc-e717-4e1b-bf63-b5f3f87bb9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:39.133657 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c60ddc-e717-4e1b-bf63-b5f3f87bb9bc None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:39.134145 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c60ddc-e717-4e1b-bf63-b5f3f87bb9bc None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:39.134676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c60ddc-e717-4e1b-bf63-b5f3f87bb9bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:39.142720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c60ddc-e717-4e1b-bf63-b5f3f87bb9bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:39.144503 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c60ddc-e717-4e1b-bf63-b5f3f87bb9bc None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:39.157265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-68c60ddc-e717-4e1b-bf63-b5f3f87bb9bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:39.157265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:39.157265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:39.157265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:39.157265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:39.157265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:39.157265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:39.157265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:39.157265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:39.157265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:39.157265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:39.157265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:39.157265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:14:39.157265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:14:39.157265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:14:39.158215 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:14:39.158215 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:39.158215 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:39.158215 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:39.158215 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:39.158215 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:39.158215 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:39.158215 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:39.158215 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:39.158215 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:39.158215 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:39.158215 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:39.158215 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:39.158215 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:39.158215 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:39.158215 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:39.158215 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:39.159121 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:14:39.159121 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:14:39.159121 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:14:39.159121 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:14:39.159121 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:14:39.159121 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:14:39.159121 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:39.159121 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:39.164993 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 316/634] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:39.165830 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c60ddc-e717-4e1b-bf63-b5f3f87bb9bc None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:39.170209 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf73c9b-99bc-4049-8b0b-29c5205a4f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:39.170865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf73c9b-99bc-4049-8b0b-29c5205a4f68 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:39.172138 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf73c9b-99bc-4049-8b0b-29c5205a4f68 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:39.172421 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf73c9b-99bc-4049-8b0b-29c5205a4f68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:39.181009 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf73c9b-99bc-4049-8b0b-29c5205a4f68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:39.183118 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf73c9b-99bc-4049-8b0b-29c5205a4f68 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:39.198400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-bdf73c9b-99bc-4049-8b0b-29c5205a4f68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:39.198400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:39.198400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:39.198400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:39.198400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:39.198400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:39.198400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:39.198400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:39.198400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:39.198400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:39.198400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:39.198400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:39.198400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:14:39.198400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:14:39.198400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:14:39.199579 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:14:39.199579 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:39.199579 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:39.199579 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:39.199579 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:39.199579 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:39.199579 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:39.199579 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:39.199579 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:39.199579 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:39.199579 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:39.199579 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:39.199579 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:39.199579 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:39.199579 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:39.199579 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:39.199579 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:39.200529 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:14:39.200529 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:14:39.200529 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:14:39.200529 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:14:39.200529 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:14:39.200529 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:14:39.200529 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:39.200529 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:39.201668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 319/635] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:39.205666 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf73c9b-99bc-4049-8b0b-29c5205a4f68 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:39.282309 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:39.302434 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c60ddc-e717-4e1b-bf63-b5f3f87bb9bc None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:39.338563 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf73c9b-99bc-4049-8b0b-29c5205a4f68 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:39.340393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e928fc-9d70-4d2f-846c-6048f7308721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:39.340999 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e928fc-9d70-4d2f-846c-6048f7308721 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:39.341304 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e928fc-9d70-4d2f-846c-6048f7308721 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:39.341579 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e928fc-9d70-4d2f-846c-6048f7308721 None admin] PATH_INFO: `/v3/projects` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:39.342901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e928fc-9d70-4d2f-846c-6048f7308721 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:39.342901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e928fc-9d70-4d2f-846c-6048f7308721 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:39.344062 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e928fc-9d70-4d2f-846c-6048f7308721 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:39.361697 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 317/636] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:14:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:39.362638 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e928fc-9d70-4d2f-846c-6048f7308721 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:39.382346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809278f8-6716-4268-a11e-bbf52566306e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:39.382951 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809278f8-6716-4268-a11e-bbf52566306e None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:39.383271 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809278f8-6716-4268-a11e-bbf52566306e None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:39.383546 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809278f8-6716-4268-a11e-bbf52566306e None admin] PATH_INFO: `/v3/projects` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:39.384232 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809278f8-6716-4268-a11e-bbf52566306e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:39.384541 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809278f8-6716-4268-a11e-bbf52566306e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:39.385984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809278f8-6716-4268-a11e-bbf52566306e None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:39.404342 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 320/637] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:14:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:39.404562 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:39.405357 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809278f8-6716-4268-a11e-bbf52566306e None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:39.495084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e928fc-9d70-4d2f-846c-6048f7308721 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:39.535653 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809278f8-6716-4268-a11e-bbf52566306e None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:39.535768 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb52f3-6e5a-4fee-8753-bd97f96610a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:39.535768 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb52f3-6e5a-4fee-8753-bd97f96610a8 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:39.535768 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb52f3-6e5a-4fee-8753-bd97f96610a8 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:39.535768 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb52f3-6e5a-4fee-8753-bd97f96610a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:39.536095 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb52f3-6e5a-4fee-8753-bd97f96610a8 None admin] RBAC: Adding query filter params (role.id=85e127a1e1b348d6bf45890be6c68b1d, scope.project.id=a63a68d37106431e80bd876cdce3e5fa, user.id=ad894f6b3613401c88cd3b39d825e61d) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:39.536095 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb52f3-6e5a-4fee-8753-bd97f96610a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:39.536095 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb52f3-6e5a-4fee-8753-bd97f96610a8 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:39.547410 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 318/638] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:14:39 2022] GET /identity/v3/role_assignments?user.id=ad894f6b3613401c88cd3b39d825e61d&scope.project.id=a63a68d37106431e80bd876cdce3e5fa&role.id=85e127a1e1b348d6bf45890be6c68b1d => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:39.554278 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:39.571985 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02ff6a-ea46-46d7-b3e6-b83bea1d902a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:39.572856 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02ff6a-ea46-46d7-b3e6-b83bea1d902a None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:39.573282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02ff6a-ea46-46d7-b3e6-b83bea1d902a None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:39.573698 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02ff6a-ea46-46d7-b3e6-b83bea1d902a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:39.574591 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02ff6a-ea46-46d7-b3e6-b83bea1d902a None admin] RBAC: Adding query filter params (role.id=85e127a1e1b348d6bf45890be6c68b1d, scope.project.id=a63a68d37106431e80bd876cdce3e5fa, user.id=c43d7aa4ecfc4a598bbaa4f4fc4e4590) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:39.575561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02ff6a-ea46-46d7-b3e6-b83bea1d902a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:39.577185 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02ff6a-ea46-46d7-b3e6-b83bea1d902a None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:39.584876 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 321/639] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:14:39 2022] GET /identity/v3/role_assignments?user.id=c43d7aa4ecfc4a598bbaa4f4fc4e4590&scope.project.id=a63a68d37106431e80bd876cdce3e5fa&role.id=85e127a1e1b348d6bf45890be6c68b1d => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:40.365280 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266299b3-ce05-4c04-bee0-f689694b1d79 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:40.365822 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266299b3-ce05-4c04-bee0-f689694b1d79 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:40.365822 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266299b3-ce05-4c04-bee0-f689694b1d79 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:40.367412 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 319/640] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:40.373347 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac0717-0ec1-49fa-b7e5-82329098ac91 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:40.373751 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac0717-0ec1-49fa-b7e5-82329098ac91 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:40.373925 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac0717-0ec1-49fa-b7e5-82329098ac91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:40.393263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-11ac0717-0ec1-49fa-b7e5-82329098ac91 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:40.394459 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-11ac0717-0ec1-49fa-b7e5-82329098ac91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:40.465313 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 322/641] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:40.799633 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266299b3-ce05-4c04-bee0-f689694b1d79 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:40.878797 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fa936-27bc-4a75-8658-ae481a46a0f4 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:40.879481 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fa936-27bc-4a75-8658-ae481a46a0f4 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:40.879969 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fa936-27bc-4a75-8658-ae481a46a0f4 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:40.882031 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 323/642] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:14:40.887517 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f5ffe-22df-4d1e-81ca-d6f979431e8d None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:40.888102 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f5ffe-22df-4d1e-81ca-d6f979431e8d None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:40.888568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f5ffe-22df-4d1e-81ca-d6f979431e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:40.904321 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:40.908283 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-3d1f5ffe-22df-4d1e-81ca-d6f979431e8d None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:40.909698 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-3d1f5ffe-22df-4d1e-81ca-d6f979431e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:40.912186 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266299b3-ce05-4c04-bee0-f689694b1d79 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:40.949858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1ab6d-69de-49ed-bdc2-1ecf1910da84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:40.950561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1ab6d-69de-49ed-bdc2-1ecf1910da84 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:40.950843 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1ab6d-69de-49ed-bdc2-1ecf1910da84 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:40.951162 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1ab6d-69de-49ed-bdc2-1ecf1910da84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:40.962787 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1ab6d-69de-49ed-bdc2-1ecf1910da84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:40.968289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-b7c1ab6d-69de-49ed-bdc2-1ecf1910da84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:40.968289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:40.968289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:40.968289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:40.968289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:40.968289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:40.968289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:40.968289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:40.968289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:40.968289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:40.968289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:40.968289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:40.968289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:40.968289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:40.968289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:40.968289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:40.969294 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:40.969294 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:40.969294 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:40.969294 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:40.969294 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:40.969294 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:40.969294 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:40.969294 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:40.969294 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:40.969294 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:40.969294 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:40.969294 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:40.969294 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:40.969294 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:40.969294 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:40.969294 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:40.970406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:40.970406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:40.970406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:40.970406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:40.970406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:40.970406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:40.970406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:40.970406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:40.970406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:40.970406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:40.970406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:40.970406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:40.970406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 320/643] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 00:14:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:40.975471 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1ab6d-69de-49ed-bdc2-1ecf1910da84 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:40.994774 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 324/644] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:41.082417 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1ab6d-69de-49ed-bdc2-1ecf1910da84 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:41.117139 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b4338-659b-4ece-90c1-414039315679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:41.117745 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b4338-659b-4ece-90c1-414039315679 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:41.118025 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b4338-659b-4ece-90c1-414039315679 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:41.118298 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b4338-659b-4ece-90c1-414039315679 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:41.118960 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b4338-659b-4ece-90c1-414039315679 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:41.119297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b4338-659b-4ece-90c1-414039315679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:41.120865 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b4338-659b-4ece-90c1-414039315679 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:41.129654 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 321/645] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:41.136109 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f5ffe-22df-4d1e-81ca-d6f979431e8d None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:41.182815 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:41.239623 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f5ffe-22df-4d1e-81ca-d6f979431e8d None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:41.279482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498875e8-0524-4b5b-9f7a-a94e1bcf8691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:41.280482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498875e8-0524-4b5b-9f7a-a94e1bcf8691 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:41.280969 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498875e8-0524-4b5b-9f7a-a94e1bcf8691 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:41.281474 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498875e8-0524-4b5b-9f7a-a94e1bcf8691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:41.292364 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498875e8-0524-4b5b-9f7a-a94e1bcf8691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:41.294169 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498875e8-0524-4b5b-9f7a-a94e1bcf8691 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:41.310348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-498875e8-0524-4b5b-9f7a-a94e1bcf8691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:41.310348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:41.310348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:41.310348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:41.310348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:41.310348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:41.310348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:41.310348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:41.310348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:41.310348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:41.310348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:41.310348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:41.310348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:41.310348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:41.310348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:41.310348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:41.311386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:41.311386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:41.311386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:41.311386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:41.311386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:41.311386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:41.311386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:41.311386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:41.311386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:41.311386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:41.311386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:41.311386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:41.311386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:41.311386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:41.311386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:41.311386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:41.311386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:41.312278 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:41.312278 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:41.312278 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:41.314660 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 325/646] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:41.320011 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b4338-659b-4ece-90c1-414039315679 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:41.339449 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:41.356422 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498875e8-0524-4b5b-9f7a-a94e1bcf8691 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:41.446750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b4338-659b-4ece-90c1-414039315679 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:41.465980 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:41.472785 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498875e8-0524-4b5b-9f7a-a94e1bcf8691 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:41.503709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dafc4a-9bf1-45f1-ac5c-0e4eb16c6ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:41.504228 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dafc4a-9bf1-45f1-ac5c-0e4eb16c6ebb None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:41.504509 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dafc4a-9bf1-45f1-ac5c-0e4eb16c6ebb None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:41.504784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dafc4a-9bf1-45f1-ac5c-0e4eb16c6ebb None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:41.505431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dafc4a-9bf1-45f1-ac5c-0e4eb16c6ebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:41.505735 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dafc4a-9bf1-45f1-ac5c-0e4eb16c6ebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:41.507158 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dafc4a-9bf1-45f1-ac5c-0e4eb16c6ebb None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:41.521237 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4325537-e93f-465b-80e4-252114c7d9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:41.522868 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4325537-e93f-465b-80e4-252114c7d9b3 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:41.523398 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4325537-e93f-465b-80e4-252114c7d9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:41.523869 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4325537-e93f-465b-80e4-252114c7d9b3 None admin] PATH_INFO: `/v3/services/image` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:41.524713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4325537-e93f-465b-80e4-252114c7d9b3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:41.527176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4325537-e93f-465b-80e4-252114c7d9b3 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:41.537692 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 322/647] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:41.538959 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dafc4a-9bf1-45f1-ac5c-0e4eb16c6ebb None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:41.547385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-e4325537-e93f-465b-80e4-252114c7d9b3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 00:14:41.547385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:41.547385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:14:41.547385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:14:41.547385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:14:41.547385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:14:41.547385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:14:41.547385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:41.547385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 00:14:41.547385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:41.547385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:14:41.547385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:41.547385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:41.547385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:41.547385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:41.547385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:41.547385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:41.550619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:41.550619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:41.550619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:41.550619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:41.550619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:41.550619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:41.550619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:14:41.550619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:14:41.550619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:14:41.550619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:14:41.550619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:41.550619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:41.550619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:41.550619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:41.550619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:41.550619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:41.554125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:41.554125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:41.554125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:41.554125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:41.554125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:41.554125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:41.554125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:41.554125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:41.554125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:41.554125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:41.554125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:14:41.554125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:41.554125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 00:14:41.554125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:41.554125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 326/648] 10.222.0.42 () {56 vars in 1105 bytes} [Wed Aug 24 00:14:41 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:41.557566 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4325537-e93f-465b-80e4-252114c7d9b3 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:41.644153 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:41.670038 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dafc4a-9bf1-45f1-ac5c-0e4eb16c6ebb None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:41.682894 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4325537-e93f-465b-80e4-252114c7d9b3 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:41.717796 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27c163-6ddd-4ace-b6ff-06966fc9d669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:41.718444 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27c163-6ddd-4ace-b6ff-06966fc9d669 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:41.718725 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27c163-6ddd-4ace-b6ff-06966fc9d669 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:41.719016 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27c163-6ddd-4ace-b6ff-06966fc9d669 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:41.727669 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27c163-6ddd-4ace-b6ff-06966fc9d669 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:41.728624 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aee0ae-ced4-46c0-8b40-33b52916039d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:41.729142 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27c163-6ddd-4ace-b6ff-06966fc9d669 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:41.729914 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aee0ae-ced4-46c0-8b40-33b52916039d None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:41.730396 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aee0ae-ced4-46c0-8b40-33b52916039d None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:41.730977 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aee0ae-ced4-46c0-8b40-33b52916039d None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:41.731979 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aee0ae-ced4-46c0-8b40-33b52916039d None admin] RBAC: Adding query filter params (name=image) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:41.732513 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aee0ae-ced4-46c0-8b40-33b52916039d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:41.734086 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aee0ae-ced4-46c0-8b40-33b52916039d None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:41.739422 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 327/649] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:41.744318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-5d27c163-6ddd-4ace-b6ff-06966fc9d669 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:14:41.744318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:41.744318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:41.744318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:41.744318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:41.744318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:41.744318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:41.744318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:41.744318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:41.744318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:41.744318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:41.744318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:41.744318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:14:41.744318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:14:41.744318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:14:41.744318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:14:41.745251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:41.745251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:41.745251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:14:41.745251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:41.745251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:14:41.745251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:41.745251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:41.745251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:41.745251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:41.745251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:41.745251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:41.745251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:41.745251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:41.745251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:41.745251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:41.745251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:41.745251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:41.745251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:41.746184 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:41.746184 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:41.746184 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:14:41.746184 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:14:41.746184 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:14:41.746184 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:14:41.746184 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:14:41.746184 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:14:41.746184 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:14:41.746184 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:41.746753 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aee0ae-ced4-46c0-8b40-33b52916039d None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:41.753346 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 323/650] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 24 00:14:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:41.755788 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27c163-6ddd-4ace-b6ff-06966fc9d669 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:41.785095 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:41.881942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aee0ae-ced4-46c0-8b40-33b52916039d None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:41.883011 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27c163-6ddd-4ace-b6ff-06966fc9d669 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:41.917839 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea815960-a391-47e6-97a4-60c1e2f79b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:41.918351 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea815960-a391-47e6-97a4-60c1e2f79b96 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:41.918628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea815960-a391-47e6-97a4-60c1e2f79b96 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:41.918897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea815960-a391-47e6-97a4-60c1e2f79b96 None admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:41.919678 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea815960-a391-47e6-97a4-60c1e2f79b96 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:41.919857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9b6f2-a640-4315-83b4-09b4275aafae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:41.919969 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea815960-a391-47e6-97a4-60c1e2f79b96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:41.920427 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9b6f2-a640-4315-83b4-09b4275aafae None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:41.920710 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9b6f2-a640-4315-83b4-09b4275aafae None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:41.921007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9b6f2-a640-4315-83b4-09b4275aafae None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:41.921486 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea815960-a391-47e6-97a4-60c1e2f79b96 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:41.921673 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9b6f2-a640-4315-83b4-09b4275aafae None admin] RBAC: Adding query filter params (type=image) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:41.921955 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9b6f2-a640-4315-83b4-09b4275aafae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:41.923495 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9b6f2-a640-4315-83b4-09b4275aafae None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:41.924937 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:41.936876 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 328/651] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:41 2022] GET /identity/v3/services?type=image => generated 122 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:41.936876 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a5a80-4d8e-4213-a875-320fbf37d1bf None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:41.936876 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a5a80-4d8e-4213-a875-320fbf37d1bf None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:41.936876 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a5a80-4d8e-4213-a875-320fbf37d1bf None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:41.936876 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 329/652] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:41.939172 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45d185-c7c2-4a58-ae4e-70e80bb69edd None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:41.939564 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45d185-c7c2-4a58-ae4e-70e80bb69edd None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:41.939940 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45d185-c7c2-4a58-ae4e-70e80bb69edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:41.952489 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 324/653] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 24 00:14:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:41.954091 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952707bb-54fc-4faa-a475-332f1a0a90f7 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:41.954488 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952707bb-54fc-4faa-a475-332f1a0a90f7 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:41.954869 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952707bb-54fc-4faa-a475-332f1a0a90f7 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:41.956816 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 325/654] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:41.958097 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952707bb-54fc-4faa-a475-332f1a0a90f7 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:41.966172 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-1e45d185-c7c2-4a58-ae4e-70e80bb69edd None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:41.968135 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-1e45d185-c7c2-4a58-ae4e-70e80bb69edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:42.044760 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 330/655] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:42.046508 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdef46-7354-404c-8197-f57e303a0dd4 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:42.046508 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdef46-7354-404c-8197-f57e303a0dd4 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:42.046917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdef46-7354-404c-8197-f57e303a0dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:42.071844 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-3bfdef46-7354-404c-8197-f57e303a0dd4 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:42.073449 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-3bfdef46-7354-404c-8197-f57e303a0dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:42.088604 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952707bb-54fc-4faa-a475-332f1a0a90f7 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:42.091137 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:42.134151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b79ce-dff2-404f-a382-1745a8e28aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:42.134758 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b79ce-dff2-404f-a382-1745a8e28aa5 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:42.135066 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b79ce-dff2-404f-a382-1745a8e28aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:42.135344 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b79ce-dff2-404f-a382-1745a8e28aa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:42.156876 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 331/656] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:42.208289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:42.217200 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b79ce-dff2-404f-a382-1745a8e28aa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:42.218858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b79ce-dff2-404f-a382-1745a8e28aa5 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:42.325411 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 326/657] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 00:14:42.330895 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdef46-7354-404c-8197-f57e303a0dd4 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:42.382056 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b79ce-dff2-404f-a382-1745a8e28aa5 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:42.436040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdef46-7354-404c-8197-f57e303a0dd4 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:42.475778 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56891a-5bd2-43c3-8832-3aae317d31be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:42.476403 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56891a-5bd2-43c3-8832-3aae317d31be None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:42.476747 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56891a-5bd2-43c3-8832-3aae317d31be None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:42.477022 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56891a-5bd2-43c3-8832-3aae317d31be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:42.490032 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56891a-5bd2-43c3-8832-3aae317d31be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:42.491640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56891a-5bd2-43c3-8832-3aae317d31be None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:42.501615 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:42.502510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:42.510735 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b79ce-dff2-404f-a382-1745a8e28aa5 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:42.516184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-7d56891a-5bd2-43c3-8832-3aae317d31be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:42.516184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:42.516184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:42.516184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:42.516184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:42.516184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:42.516184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:42.516184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:42.516184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:42.516184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:42.516184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:42.516184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:42.516184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:42.516184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:42.516184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:42.516184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:42.517176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:42.517176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:42.517176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:42.517176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:42.517176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:42.517176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:42.517176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:42.517176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:42.517176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:42.517176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:42.517176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:42.517176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:42.517176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:42.517176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:42.517176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:42.517176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:42.517176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:42.518239 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:42.518239 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:42.518239 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:42.520252 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 332/658] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:42.521066 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56891a-5bd2-43c3-8832-3aae317d31be None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:42.555472 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5c2ce-9bc3-46ac-b674-1dd8bb8b3bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:42.556095 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5c2ce-9bc3-46ac-b674-1dd8bb8b3bbf None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:42.556371 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5c2ce-9bc3-46ac-b674-1dd8bb8b3bbf None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:42.556641 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5c2ce-9bc3-46ac-b674-1dd8bb8b3bbf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:42.557221 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5c2ce-9bc3-46ac-b674-1dd8bb8b3bbf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:42.558638 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5c2ce-9bc3-46ac-b674-1dd8bb8b3bbf None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:42.570853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-cca5c2ce-9bc3-46ac-b674-1dd8bb8b3bbf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 00:14:42.570853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:42.570853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:14:42.570853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:14:42.570853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:14:42.570853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:14:42.570853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:14:42.570853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:42.570853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 00:14:42.570853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:42.570853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:14:42.570853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:42.570853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:42.570853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:42.570853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:42.570853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:42.570853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:42.571933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:42.571933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:42.571933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:42.571933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:42.571933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:42.571933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:42.571933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:14:42.571933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:14:42.571933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:14:42.571933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:14:42.571933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:42.571933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:42.571933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:42.571933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:42.571933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:42.571933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:42.572774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:42.572774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:42.572774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:42.572774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:42.572774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:42.572774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:42.572774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:42.572774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:42.572774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:42.572774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:42.572774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:14:42.572774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:42.572774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 00:14:42.572774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:42.572774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 327/659] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Aug 24 00:14:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:42.573601 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5c2ce-9bc3-46ac-b674-1dd8bb8b3bbf None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:42.640411 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56891a-5bd2-43c3-8832-3aae317d31be None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:42.677268 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae089c0-cb8a-4475-8588-9e4aea4bc8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:42.677894 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae089c0-cb8a-4475-8588-9e4aea4bc8af None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:42.678175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae089c0-cb8a-4475-8588-9e4aea4bc8af None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:42.678500 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae089c0-cb8a-4475-8588-9e4aea4bc8af None admin] PATH_INFO: `/v3/services/network` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:42.679137 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae089c0-cb8a-4475-8588-9e4aea4bc8af None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:42.680550 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae089c0-cb8a-4475-8588-9e4aea4bc8af None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:42.682211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5c2ce-9bc3-46ac-b674-1dd8bb8b3bbf None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:42.690713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-fae089c0-cb8a-4475-8588-9e4aea4bc8af None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 00:14:42.690713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:42.690713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:14:42.690713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:14:42.690713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:14:42.690713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:14:42.690713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:14:42.690713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:42.690713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 00:14:42.690713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:42.690713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:14:42.690713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:42.690713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:42.690713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:42.690713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:42.690713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:42.690713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:42.691864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:42.691864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:42.691864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:42.691864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:42.691864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:42.691864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:42.691864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:14:42.691864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:14:42.691864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:14:42.691864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:14:42.691864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:42.691864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:42.691864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:42.691864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:42.691864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:42.691864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:42.695799 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:42.695799 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:42.695799 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:42.695799 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:42.695799 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:42.695799 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:42.695799 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:42.695799 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:42.695799 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:42.695799 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:42.695799 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:14:42.695799 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:42.695799 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 00:14:42.695799 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:42.695799 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 333/660] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:42 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:42.696593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae089c0-cb8a-4475-8588-9e4aea4bc8af None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:42.724202 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16124d3-2790-4242-b745-f951de047c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:42.724805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16124d3-2790-4242-b745-f951de047c01 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:42.725450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16124d3-2790-4242-b745-f951de047c01 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:42.725450 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16124d3-2790-4242-b745-f951de047c01 None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:42.726153 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16124d3-2790-4242-b745-f951de047c01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:42.726287 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16124d3-2790-4242-b745-f951de047c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:42.727684 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16124d3-2790-4242-b745-f951de047c01 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:42.743850 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 328/661] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:42.743850 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16124d3-2790-4242-b745-f951de047c01 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:42.760111 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:42.777712 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:42.821898 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae089c0-cb8a-4475-8588-9e4aea4bc8af None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:42.858636 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16124d3-2790-4242-b745-f951de047c01 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:42.861906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aae75e-310c-42d0-8d91-58cdd90ca762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:42.862680 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aae75e-310c-42d0-8d91-58cdd90ca762 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:42.863161 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aae75e-310c-42d0-8d91-58cdd90ca762 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:42.863495 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aae75e-310c-42d0-8d91-58cdd90ca762 None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:42.864122 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aae75e-310c-42d0-8d91-58cdd90ca762 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:42.864474 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aae75e-310c-42d0-8d91-58cdd90ca762 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:42.865905 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aae75e-310c-42d0-8d91-58cdd90ca762 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:42.874913 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 334/662] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 24 00:14:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:42.874913 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aae75e-310c-42d0-8d91-58cdd90ca762 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:42.900696 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252bbcc-5508-4d48-bd24-cf6610e74341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:42.901288 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252bbcc-5508-4d48-bd24-cf6610e74341 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:42.901563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252bbcc-5508-4d48-bd24-cf6610e74341 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:42.901835 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252bbcc-5508-4d48-bd24-cf6610e74341 None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:42.902462 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252bbcc-5508-4d48-bd24-cf6610e74341 None admin] RBAC: Adding query filter params (name=network) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:42.902760 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252bbcc-5508-4d48-bd24-cf6610e74341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:42.904936 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252bbcc-5508-4d48-bd24-cf6610e74341 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:42.909569 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 329/663] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 00:14:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:42.910375 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252bbcc-5508-4d48-bd24-cf6610e74341 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:42.989008 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aae75e-310c-42d0-8d91-58cdd90ca762 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:43.005832 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:43.017202 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:43.025822 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ca0ce-5b8a-4647-81ae-a498dc375afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:43.026442 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ca0ce-5b8a-4647-81ae-a498dc375afd None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:43.026717 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ca0ce-5b8a-4647-81ae-a498dc375afd None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:43.026986 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ca0ce-5b8a-4647-81ae-a498dc375afd None admin] PATH_INFO: `/v3/projects/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:43.027167 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252bbcc-5508-4d48-bd24-cf6610e74341 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:43.034363 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ca0ce-5b8a-4647-81ae-a498dc375afd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:43.035863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ca0ce-5b8a-4647-81ae-a498dc375afd None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:43.047226 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-b31ca0ce-5b8a-4647-81ae-a498dc375afd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:43.047226 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:43.047226 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:43.047226 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:43.047226 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:43.047226 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:43.047226 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:43.047226 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:43.047226 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:43.047226 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:43.047226 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:43.047226 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:43.047226 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:14:43.047226 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:14:43.047226 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:14:43.048308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:14:43.048308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:43.048308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:43.048308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:43.048308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:43.048308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:43.048308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:43.048308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:43.048308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:43.048308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:43.048308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:43.048308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:43.048308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:43.048308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:43.048308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:43.048308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:43.048308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:43.054178 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:14:43.054178 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:14:43.054178 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:14:43.054178 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:14:43.054178 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:14:43.054178 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:14:43.054178 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:43.054178 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:43.054178 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 335/664] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:43.054178 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ca0ce-5b8a-4647-81ae-a498dc375afd None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:43.071692 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699c671-5748-45f1-9100-5756045a2e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:43.072406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699c671-5748-45f1-9100-5756045a2e5b None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:43.072747 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699c671-5748-45f1-9100-5756045a2e5b None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:43.073107 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699c671-5748-45f1-9100-5756045a2e5b None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:43.073840 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699c671-5748-45f1-9100-5756045a2e5b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:43.074214 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699c671-5748-45f1-9100-5756045a2e5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:43.076281 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699c671-5748-45f1-9100-5756045a2e5b None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:43.082776 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 330/665] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 24 00:14:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:43.083402 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699c671-5748-45f1-9100-5756045a2e5b None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:43.178839 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ca0ce-5b8a-4647-81ae-a498dc375afd None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:43.218627 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d05ef-6255-4a4c-ad72-8cf7733263c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:43.219358 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d05ef-6255-4a4c-ad72-8cf7733263c5 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:43.219646 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d05ef-6255-4a4c-ad72-8cf7733263c5 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:43.220879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d05ef-6255-4a4c-ad72-8cf7733263c5 None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:43.221533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d05ef-6255-4a4c-ad72-8cf7733263c5 None admin] RBAC: Adding query filter params (type=network) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:43.221976 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d05ef-6255-4a4c-ad72-8cf7733263c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:43.223500 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d05ef-6255-4a4c-ad72-8cf7733263c5 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:43.234115 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 336/666] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 00:14:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:43.237136 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699c671-5748-45f1-9100-5756045a2e5b None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:43.281271 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a6cc2-53ef-48ee-b854-344cea6dbaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:43.282096 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a6cc2-53ef-48ee-b854-344cea6dbaa7 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:43.282462 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a6cc2-53ef-48ee-b854-344cea6dbaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:43.282816 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a6cc2-53ef-48ee-b854-344cea6dbaa7 None admin] PATH_INFO: `/v3/projects` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:43.283638 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a6cc2-53ef-48ee-b854-344cea6dbaa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:43.284033 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a6cc2-53ef-48ee-b854-344cea6dbaa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:43.285766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a6cc2-53ef-48ee-b854-344cea6dbaa7 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:43.300869 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 331/667] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:14:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:43.307120 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d05ef-6255-4a4c-ad72-8cf7733263c5 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:43.370340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:43.433385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d05ef-6255-4a4c-ad72-8cf7733263c5 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:43.472011 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29f931-05a8-460a-b318-56810acbebe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:43.472714 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29f931-05a8-460a-b318-56810acbebe5 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:43.473192 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29f931-05a8-460a-b318-56810acbebe5 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:43.473539 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29f931-05a8-460a-b318-56810acbebe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:43.474343 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29f931-05a8-460a-b318-56810acbebe5 None admin] RBAC: Adding query filter params (role.id=9b372d4fe82a4a54a3ecd29e7b912586, scope.project.id=a63a68d37106431e80bd876cdce3e5fa, user.id=a863e95438d14892816e4f3c94673025) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:43.474725 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29f931-05a8-460a-b318-56810acbebe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:43.476263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29f931-05a8-460a-b318-56810acbebe5 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:43.482713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 337/668] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:14:43 2022] GET /identity/v3/role_assignments?user.id=a863e95438d14892816e4f3c94673025&scope.project.id=a63a68d37106431e80bd876cdce3e5fa&role.id=9b372d4fe82a4a54a3ecd29e7b912586 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:44.184341 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b869b11-4e17-4ebe-8f46-cd1f3304fdf1 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:44.185407 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b869b11-4e17-4ebe-8f46-cd1f3304fdf1 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:44.185592 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b869b11-4e17-4ebe-8f46-cd1f3304fdf1 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:44.187193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 332/669] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:44.192947 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032231f-3dc7-43b4-b946-e2f9f6989a0e None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:44.193449 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032231f-3dc7-43b4-b946-e2f9f6989a0e None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:44.193873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032231f-3dc7-43b4-b946-e2f9f6989a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:44.213238 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-7032231f-3dc7-43b4-b946-e2f9f6989a0e None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:44.214638 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-7032231f-3dc7-43b4-b946-e2f9f6989a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:44.283993 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 338/670] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 00:14:44.626938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b869b11-4e17-4ebe-8f46-cd1f3304fdf1 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:44.636757 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:44.738469 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b869b11-4e17-4ebe-8f46-cd1f3304fdf1 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:44.777977 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b11c32-f2d2-4b37-be04-ea57e4fd89e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:44.779037 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b11c32-f2d2-4b37-be04-ea57e4fd89e1 None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:44.779319 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b11c32-f2d2-4b37-be04-ea57e4fd89e1 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:44.779587 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b11c32-f2d2-4b37-be04-ea57e4fd89e1 None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:44.780239 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b11c32-f2d2-4b37-be04-ea57e4fd89e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:44.781618 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b11c32-f2d2-4b37-be04-ea57e4fd89e1 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:44.800922 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 333/671] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 00:14:44 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:14:45.445677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25978bde-e4aa-482e-9cea-3983f76e70ed None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:45.446219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25978bde-e4aa-482e-9cea-3983f76e70ed None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:45.446219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25978bde-e4aa-482e-9cea-3983f76e70ed None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:45.447966 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 339/672] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:45.453964 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c959d0-8a3d-40ea-8eee-acba93cbd80e None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:45.454403 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c959d0-8a3d-40ea-8eee-acba93cbd80e None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:45.454577 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c959d0-8a3d-40ea-8eee-acba93cbd80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:45.474538 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-76c959d0-8a3d-40ea-8eee-acba93cbd80e None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:45.475783 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-76c959d0-8a3d-40ea-8eee-acba93cbd80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:45.535048 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5b423-2c27-4bff-b521-648c8da0604e None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:45.535341 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5b423-2c27-4bff-b521-648c8da0604e None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:45.535602 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5b423-2c27-4bff-b521-648c8da0604e None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:45.537171 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 340/673] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:14:45.542025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717b308-bad1-40cc-851a-17b99d9f7e4b None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:45.542314 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717b308-bad1-40cc-851a-17b99d9f7e4b None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:45.542590 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717b308-bad1-40cc-851a-17b99d9f7e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:45.553067 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:45.561642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-c717b308-bad1-40cc-851a-17b99d9f7e4b None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:45.563120 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-c717b308-bad1-40cc-851a-17b99d9f7e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:45.575185 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 334/674] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:45 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:45.609488 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:45.643865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 341/675] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:45 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:45.782313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d971e-b58e-4430-9a96-f50ff61bc31b None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:45.782683 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d971e-b58e-4430-9a96-f50ff61bc31b None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:45.782874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d971e-b58e-4430-9a96-f50ff61bc31b None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:45.784491 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 335/676] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:45.789789 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b9bdf-3b7c-45fe-bec0-1cb46c959bf1 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:45.790075 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b9bdf-3b7c-45fe-bec0-1cb46c959bf1 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:45.790350 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b9bdf-3b7c-45fe-bec0-1cb46c959bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:45.808662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-907b9bdf-3b7c-45fe-bec0-1cb46c959bf1 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:45.810365 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-907b9bdf-3b7c-45fe-bec0-1cb46c959bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:45.882385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 342/677] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:45 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 00:14:45.921178 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d971e-b58e-4430-9a96-f50ff61bc31b None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:45.989956 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b9bdf-3b7c-45fe-bec0-1cb46c959bf1 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:46.034389 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d971e-b58e-4430-9a96-f50ff61bc31b None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:46.073229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c394b-a22a-4268-84f5-7a17a0602734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:46.073834 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c394b-a22a-4268-84f5-7a17a0602734 None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:46.074226 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c394b-a22a-4268-84f5-7a17a0602734 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:46.074501 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c394b-a22a-4268-84f5-7a17a0602734 None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:46.075327 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c394b-a22a-4268-84f5-7a17a0602734 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:46.076705 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c394b-a22a-4268-84f5-7a17a0602734 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:46.103142 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 336/678] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 00:14:45 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:14:46.120291 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b9bdf-3b7c-45fe-bec0-1cb46c959bf1 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:46.129873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:46.168261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602549c-f54a-4c96-a64e-9907bf8559e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:46.169481 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602549c-f54a-4c96-a64e-9907bf8559e9 None admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:46.169760 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602549c-f54a-4c96-a64e-9907bf8559e9 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:46.170036 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602549c-f54a-4c96-a64e-9907bf8559e9 None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:46.170824 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602549c-f54a-4c96-a64e-9907bf8559e9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:46.172474 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602549c-f54a-4c96-a64e-9907bf8559e9 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:46.192423 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 343/679] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 00:14:45 2022] POST /identity/v3/services => generated 240 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:14:46.219407 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c394b-a22a-4268-84f5-7a17a0602734 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:46.291067 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:46.352426 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c394b-a22a-4268-84f5-7a17a0602734 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:46.397145 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b041475-de49-41b9-926d-97ce0d2df158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:46.397783 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b041475-de49-41b9-926d-97ce0d2df158 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:46.398063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b041475-de49-41b9-926d-97ce0d2df158 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:46.398335 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b041475-de49-41b9-926d-97ce0d2df158 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:46.410339 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b041475-de49-41b9-926d-97ce0d2df158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:46.415708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-9b041475-de49-41b9-926d-97ce0d2df158 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:46.415708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:46.415708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:46.415708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:46.415708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:46.415708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:46.415708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:46.415708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:46.415708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:46.415708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:46.415708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:46.415708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:46.415708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:46.415708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:46.415708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:46.415708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:46.416797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:46.416797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:46.416797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:46.416797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:46.416797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:46.416797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:46.416797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:46.416797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:46.416797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:46.416797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:46.416797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:46.416797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:46.416797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:46.416797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:46.416797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:46.416797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:46.417763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:46.417763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:46.417763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:46.417763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:46.417763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:46.417763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:46.417763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:46.417763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:46.417763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:46.417763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:46.417763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:46.417763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:46.417763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 337/680] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 00:14:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:46.423570 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602549c-f54a-4c96-a64e-9907bf8559e9 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:46.537686 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602549c-f54a-4c96-a64e-9907bf8559e9 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:46.574849 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3cfe3-ace8-440d-a63c-29424a616990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:46.575805 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3cfe3-ace8-440d-a63c-29424a616990 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:46.576291 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3cfe3-ace8-440d-a63c-29424a616990 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:46.576757 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3cfe3-ace8-440d-a63c-29424a616990 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:46.577605 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3cfe3-ace8-440d-a63c-29424a616990 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:46.578091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3cfe3-ace8-440d-a63c-29424a616990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:46.579669 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3cfe3-ace8-440d-a63c-29424a616990 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:46.591272 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 344/681] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:46.596357 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b041475-de49-41b9-926d-97ce0d2df158 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:46.706348 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b041475-de49-41b9-926d-97ce0d2df158 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:46.728845 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:46.744527 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9962dac-3ff8-46c6-a98f-fb37b775cf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:46.745545 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9962dac-3ff8-46c6-a98f-fb37b775cf83 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:46.746008 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9962dac-3ff8-46c6-a98f-fb37b775cf83 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:46.746464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9962dac-3ff8-46c6-a98f-fb37b775cf83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:46.759634 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9962dac-3ff8-46c6-a98f-fb37b775cf83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:46.761399 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9962dac-3ff8-46c6-a98f-fb37b775cf83 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:46.777573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-e9962dac-3ff8-46c6-a98f-fb37b775cf83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:46.777573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:46.777573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:46.777573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:46.777573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:46.777573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:46.777573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:46.777573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:46.777573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:46.777573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:46.777573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:46.777573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:46.777573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:46.777573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:46.777573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:46.777573 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:46.779414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:46.779414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:46.779414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:46.779414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:46.779414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:46.779414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:46.779414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:46.779414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:46.779414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:46.779414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:46.779414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:46.779414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:46.779414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:46.779414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:46.779414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:46.779414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:46.779414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:46.780575 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:46.780575 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:46.780575 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:46.782368 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 338/682] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:46.787679 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3cfe3-ace8-440d-a63c-29424a616990 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:46.814219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:46.892970 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3cfe3-ace8-440d-a63c-29424a616990 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:46.928419 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725334b-d51b-4f2a-8c21-6e79e400c1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:46.929026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725334b-d51b-4f2a-8c21-6e79e400c1fc None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:46.929307 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725334b-d51b-4f2a-8c21-6e79e400c1fc None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:46.929580 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725334b-d51b-4f2a-8c21-6e79e400c1fc None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:46.930221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725334b-d51b-4f2a-8c21-6e79e400c1fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:46.930526 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725334b-d51b-4f2a-8c21-6e79e400c1fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:46.931944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725334b-d51b-4f2a-8c21-6e79e400c1fc None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:46.944528 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 345/683] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:46.950754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9962dac-3ff8-46c6-a98f-fb37b775cf83 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:47.061101 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9962dac-3ff8-46c6-a98f-fb37b775cf83 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:47.099272 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce6163-787d-495a-9404-d49c9bb7295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:47.100138 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce6163-787d-495a-9404-d49c9bb7295c None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:47.100634 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce6163-787d-495a-9404-d49c9bb7295c None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:47.101071 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce6163-787d-495a-9404-d49c9bb7295c None admin] PATH_INFO: `/v3/users/nova` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:47.110064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce6163-787d-495a-9404-d49c9bb7295c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:47.111898 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce6163-787d-495a-9404-d49c9bb7295c None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:47.124969 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-2dce6163-787d-495a-9404-d49c9bb7295c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:14:47.124969 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:47.124969 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:47.124969 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:47.124969 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:47.124969 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:47.124969 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:47.124969 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:47.124969 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:47.124969 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:47.124969 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:47.124969 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:47.124969 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:14:47.124969 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:14:47.124969 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:14:47.124969 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:14:47.126155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:47.126155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:47.126155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:14:47.126155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:47.126155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:14:47.126155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:47.126155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:47.126155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:47.126155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:47.126155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:47.126155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:47.126155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:47.126155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:47.126155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:47.126155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:47.126155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:47.126155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:47.126155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:47.127424 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:47.127424 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:47.127424 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:14:47.127424 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:14:47.127424 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:14:47.127424 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:14:47.127424 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:14:47.127424 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:14:47.127424 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:14:47.127424 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:47.129453 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 339/684] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 24 00:14:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:47.138224 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725334b-d51b-4f2a-8c21-6e79e400c1fc None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:47.139965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42484f2-ab77-46e1-a710-2f9d2e4d1c71 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:47.140431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42484f2-ab77-46e1-a710-2f9d2e4d1c71 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:47.140909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42484f2-ab77-46e1-a710-2f9d2e4d1c71 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:47.142460 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 340/685] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:47.147758 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa051763-bae3-433e-a6d6-ac4def4172a1 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:47.147979 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa051763-bae3-433e-a6d6-ac4def4172a1 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:47.148252 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa051763-bae3-433e-a6d6-ac4def4172a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:47.166796 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-aa051763-bae3-433e-a6d6-ac4def4172a1 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:47.168108 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-aa051763-bae3-433e-a6d6-ac4def4172a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:47.183456 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:47.224181 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:47.240816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725334b-d51b-4f2a-8c21-6e79e400c1fc None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:47.249688 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 341/686] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:47 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 00:14:47.276334 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1ede3-d6d5-4617-8563-d589c9b969fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:47.276933 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1ede3-d6d5-4617-8563-d589c9b969fc None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:47.277213 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1ede3-d6d5-4617-8563-d589c9b969fc None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:47.277483 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1ede3-d6d5-4617-8563-d589c9b969fc None admin] PATH_INFO: `/v3/users` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:47.278239 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1ede3-d6d5-4617-8563-d589c9b969fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:47.278546 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1ede3-d6d5-4617-8563-d589c9b969fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:47.280011 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1ede3-d6d5-4617-8563-d589c9b969fc None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:47.297941 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 346/687] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 24 00:14:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:47.303431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa051763-bae3-433e-a6d6-ac4def4172a1 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:47.407679 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa051763-bae3-433e-a6d6-ac4def4172a1 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:47.443067 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f1a53-d98f-44fc-8fc7-c61db4da3934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:47.443702 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f1a53-d98f-44fc-8fc7-c61db4da3934 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:47.443979 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f1a53-d98f-44fc-8fc7-c61db4da3934 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:47.444251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f1a53-d98f-44fc-8fc7-c61db4da3934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:47.459019 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f1a53-d98f-44fc-8fc7-c61db4da3934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:47.460849 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f1a53-d98f-44fc-8fc7-c61db4da3934 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:47.478125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-ce9f1a53-d98f-44fc-8fc7-c61db4da3934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:47.478125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:47.478125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:47.478125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:47.478125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:47.478125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:47.478125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:47.478125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:47.478125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:47.478125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:47.478125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:47.478125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:47.478125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:47.478125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:47.478125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:47.478125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:47.479207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:47.479207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:47.479207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:47.479207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:47.479207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:47.479207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:47.479207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:47.479207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:47.479207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:47.479207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:47.479207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:47.479207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:47.479207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:47.479207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:47.479207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:47.479207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:47.479207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:47.480130 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:47.480130 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:47.480130 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:47.482972 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 342/688] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:47.495035 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1ede3-d6d5-4617-8563-d589c9b969fc None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:47.585751 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f1a53-d98f-44fc-8fc7-c61db4da3934 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:47.591282 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:47.591599 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1ede3-d6d5-4617-8563-d589c9b969fc None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:47.627690 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b746d-12b7-4085-9589-78d98cb8fdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:47.628344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b746d-12b7-4085-9589-78d98cb8fdfa None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:47.628630 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b746d-12b7-4085-9589-78d98cb8fdfa None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:47.629885 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b746d-12b7-4085-9589-78d98cb8fdfa None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:47.629885 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b746d-12b7-4085-9589-78d98cb8fdfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:47.630091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b746d-12b7-4085-9589-78d98cb8fdfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:47.631440 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b746d-12b7-4085-9589-78d98cb8fdfa None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:47.643617 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 347/689] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:47.649102 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b746d-12b7-4085-9589-78d98cb8fdfa None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:47.652395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:47.711213 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f1a53-d98f-44fc-8fc7-c61db4da3934 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:47.748679 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dc08a-c3eb-43a2-81ae-b7ed5d19ec9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:47.749638 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dc08a-c3eb-43a2-81ae-b7ed5d19ec9f None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:47.750160 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dc08a-c3eb-43a2-81ae-b7ed5d19ec9f None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:47.750661 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dc08a-c3eb-43a2-81ae-b7ed5d19ec9f None admin] PATH_INFO: `/v3/services/image` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:47.751705 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037dc08a-c3eb-43a2-81ae-b7ed5d19ec9f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:47.753420 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037dc08a-c3eb-43a2-81ae-b7ed5d19ec9f None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:47.754474 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b746d-12b7-4085-9589-78d98cb8fdfa None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:47.762980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-037dc08a-c3eb-43a2-81ae-b7ed5d19ec9f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 00:14:47.762980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:47.762980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:14:47.762980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:14:47.762980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:14:47.762980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:14:47.762980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:14:47.762980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:47.762980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 00:14:47.762980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:47.762980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:14:47.762980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:47.762980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:47.762980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:47.762980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:47.762980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:47.762980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:47.763970 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:47.763970 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:47.763970 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:47.763970 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:47.763970 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:47.763970 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:47.763970 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:14:47.763970 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:14:47.763970 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:14:47.763970 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:14:47.763970 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:47.763970 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:47.763970 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:47.763970 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:47.763970 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:47.763970 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:47.764835 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:47.764835 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:47.764835 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:47.764835 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:47.764835 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:47.764835 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:47.764835 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:47.764835 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:47.764835 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:47.764835 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:47.764835 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:14:47.764835 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:47.764835 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 00:14:47.764835 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:47.772548 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 343/690] 10.222.0.42 () {56 vars in 1105 bytes} [Wed Aug 24 00:14:47 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:47.773648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dc08a-c3eb-43a2-81ae-b7ed5d19ec9f None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:47.790444 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc69ded-f6b2-44f1-8736-e387d5203d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:47.791103 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc69ded-f6b2-44f1-8736-e387d5203d6d None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:47.791470 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc69ded-f6b2-44f1-8736-e387d5203d6d None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:47.791704 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc69ded-f6b2-44f1-8736-e387d5203d6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:47.799311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc69ded-f6b2-44f1-8736-e387d5203d6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:47.800833 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc69ded-f6b2-44f1-8736-e387d5203d6d None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:47.812357 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-fcc69ded-f6b2-44f1-8736-e387d5203d6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:47.812357 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:47.812357 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:47.812357 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:47.812357 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:47.812357 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:47.812357 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:47.812357 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:47.812357 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:47.812357 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:47.812357 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:47.812357 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:47.812357 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:14:47.812357 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:14:47.812357 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:14:47.813539 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:14:47.813539 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:47.813539 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:47.813539 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:47.813539 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:47.813539 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:47.813539 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:47.813539 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:47.813539 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:47.813539 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:47.813539 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:47.813539 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:47.813539 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:47.813539 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:47.813539 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:47.813539 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:47.813539 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:47.814440 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:14:47.814440 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:14:47.814440 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:14:47.814440 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:14:47.814440 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:14:47.814440 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:14:47.814440 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:47.814440 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:47.818747 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 348/691] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:47.819642 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc69ded-f6b2-44f1-8736-e387d5203d6d None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:47.854845 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:47.884002 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:47.898883 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dc08a-c3eb-43a2-81ae-b7ed5d19ec9f None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:47.925397 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc69ded-f6b2-44f1-8736-e387d5203d6d None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:47.938591 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c2c15-8c60-410c-8c48-34cc313717e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:47.939570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c2c15-8c60-410c-8c48-34cc313717e2 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:47.940122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c2c15-8c60-410c-8c48-34cc313717e2 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:47.940773 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c2c15-8c60-410c-8c48-34cc313717e2 None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:47.941613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c2c15-8c60-410c-8c48-34cc313717e2 None admin] RBAC: Adding query filter params (name=image) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:47.942249 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c2c15-8c60-410c-8c48-34cc313717e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:47.944520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c2c15-8c60-410c-8c48-34cc313717e2 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:47.954805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 344/692] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:47.956134 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c2c15-8c60-410c-8c48-34cc313717e2 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:47.961182 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5842c-5df4-42cc-8dbc-cd13e1772c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:47.961595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5842c-5df4-42cc-8dbc-cd13e1772c77 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:47.961823 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5842c-5df4-42cc-8dbc-cd13e1772c77 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:47.962096 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5842c-5df4-42cc-8dbc-cd13e1772c77 None admin] PATH_INFO: `/v3/projects` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:47.962785 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e5842c-5df4-42cc-8dbc-cd13e1772c77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:47.963121 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e5842c-5df4-42cc-8dbc-cd13e1772c77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:47.964619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e5842c-5df4-42cc-8dbc-cd13e1772c77 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:47.983132 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 349/693] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:14:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:47.984544 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5842c-5df4-42cc-8dbc-cd13e1772c77 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:48.074427 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c2c15-8c60-410c-8c48-34cc313717e2 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:48.089522 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5842c-5df4-42cc-8dbc-cd13e1772c77 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:48.108150 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:48.113936 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:48.116696 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008d0d4-3f0c-4e59-8533-4b41da7a6204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:48.117574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008d0d4-3f0c-4e59-8533-4b41da7a6204 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:48.118769 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008d0d4-3f0c-4e59-8533-4b41da7a6204 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:48.119637 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008d0d4-3f0c-4e59-8533-4b41da7a6204 None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:48.120565 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008d0d4-3f0c-4e59-8533-4b41da7a6204 None admin] RBAC: Adding query filter params (type=image) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:48.121090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008d0d4-3f0c-4e59-8533-4b41da7a6204 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:48.123469 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008d0d4-3f0c-4e59-8533-4b41da7a6204 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:48.126807 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08a02c-48c5-4015-93a6-67d9d7bb446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:48.127496 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08a02c-48c5-4015-93a6-67d9d7bb446c None admin] REQUEST_METHOD: `PUT` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:48.127900 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08a02c-48c5-4015-93a6-67d9d7bb446c None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:48.128233 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08a02c-48c5-4015-93a6-67d9d7bb446c None admin] PATH_INFO: `/v3/projects/a63a68d37106431e80bd876cdce3e5fa/users/a863e95438d14892816e4f3c94673025/roles/9b372d4fe82a4a54a3ecd29e7b912586` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:48.130077 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08a02c-48c5-4015-93a6-67d9d7bb446c None admin] RBAC: Authorizing `identity:create_grant(project_id=a63a68d37106431e80bd876cdce3e5fa, user_id=a863e95438d14892816e4f3c94673025, role_id=9b372d4fe82a4a54a3ecd29e7b912586)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:48.135613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08a02c-48c5-4015-93a6-67d9d7bb446c None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:48.136143 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 345/694] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:48.137209 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008d0d4-3f0c-4e59-8533-4b41da7a6204 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:48.155094 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 350/695] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 00:14:47 2022] PUT /identity/v3/projects/a63a68d37106431e80bd876cdce3e5fa/users/a863e95438d14892816e4f3c94673025/roles/9b372d4fe82a4a54a3ecd29e7b912586 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 00:14:48.265731 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008d0d4-3f0c-4e59-8533-4b41da7a6204 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:48.306156 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32c03d-96e6-466d-aadf-c0319c2780e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:48.306948 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32c03d-96e6-466d-aadf-c0319c2780e8 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:48.307514 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32c03d-96e6-466d-aadf-c0319c2780e8 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:48.307888 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32c03d-96e6-466d-aadf-c0319c2780e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:48.308705 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32c03d-96e6-466d-aadf-c0319c2780e8 None admin] RBAC: Adding query filter params (interface=public, service_id=fac8e206c8444c29a357b8f31a789534, region_id=RegionOne) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:48.309107 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32c03d-96e6-466d-aadf-c0319c2780e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:48.311190 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32c03d-96e6-466d-aadf-c0319c2780e8 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:48.321437 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 346/696] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 24 00:14:48 2022] GET /identity/v3/endpoints?service_id=fac8e206c8444c29a357b8f31a789534&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:48.327476 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08a02c-48c5-4015-93a6-67d9d7bb446c None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:48.440727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08a02c-48c5-4015-93a6-67d9d7bb446c None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:48.477224 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7c617-ef9c-4092-a972-14a33153d216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:48.478105 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7c617-ef9c-4092-a972-14a33153d216 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:48.478533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7c617-ef9c-4092-a972-14a33153d216 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:48.479077 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7c617-ef9c-4092-a972-14a33153d216 None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:48.479885 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7c617-ef9c-4092-a972-14a33153d216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:48.481602 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7c617-ef9c-4092-a972-14a33153d216 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:48.488485 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 351/697] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 24 00:14:48 2022] GET /identity/v3/services => generated 1002 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:14:48.496558 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99dd970-dd74-4702-9d6b-526bc27545d0 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:48.497528 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99dd970-dd74-4702-9d6b-526bc27545d0 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:48.497905 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99dd970-dd74-4702-9d6b-526bc27545d0 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:48.499898 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 347/698] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:48.508297 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173e3c6-1df3-47a1-b150-bb80a20d79e4 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:48.508736 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173e3c6-1df3-47a1-b150-bb80a20d79e4 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:48.509118 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173e3c6-1df3-47a1-b150-bb80a20d79e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:48.529914 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-0173e3c6-1df3-47a1-b150-bb80a20d79e4 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:48.531309 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-0173e3c6-1df3-47a1-b150-bb80a20d79e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:48.583833 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:48.614644 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 352/699] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:48 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:14:48.662516 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d0e06-dc02-47a5-813b-16d27c84534f None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:48.662838 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d0e06-dc02-47a5-813b-16d27c84534f None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:48.663209 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d0e06-dc02-47a5-813b-16d27c84534f None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:48.664986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 348/700] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:48.675762 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc97ab4-acf4-4d71-a49a-a8ec1750c6e6 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:48.676047 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc97ab4-acf4-4d71-a49a-a8ec1750c6e6 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:48.676326 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc97ab4-acf4-4d71-a49a-a8ec1750c6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:48.696277 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-3fc97ab4-acf4-4d71-a49a-a8ec1750c6e6 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:48.697486 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-3fc97ab4-acf4-4d71-a49a-a8ec1750c6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:48.775194 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 353/701] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:48 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:14:48.975897 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d0e06-dc02-47a5-813b-16d27c84534f None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:49.041166 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:49.085691 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d0e06-dc02-47a5-813b-16d27c84534f None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:49.103569 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc97ab4-acf4-4d71-a49a-a8ec1750c6e6 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:49.129401 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a5b84-3275-46e1-ae70-cc606675b960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:49.130038 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a5b84-3275-46e1-ae70-cc606675b960 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:49.130317 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a5b84-3275-46e1-ae70-cc606675b960 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:49.130751 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a5b84-3275-46e1-ae70-cc606675b960 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:49.131688 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a5b84-3275-46e1-ae70-cc606675b960 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:49.133350 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a5b84-3275-46e1-ae70-cc606675b960 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:49.145064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-fd6a5b84-3275-46e1-ae70-cc606675b960 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 00:14:49.145064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:49.145064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:14:49.145064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:14:49.145064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:14:49.145064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:14:49.145064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:14:49.145064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:49.145064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 00:14:49.145064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:49.145064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:14:49.145064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:49.145064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:49.145064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:49.145064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:49.145064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:49.145064 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:49.146256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:49.146256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:49.146256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:49.146256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:49.146256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:49.146256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:49.146256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:14:49.146256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:14:49.146256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:14:49.146256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:14:49.146256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:49.146256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:49.146256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:49.146256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:49.146256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:49.146256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:49.147295 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:49.147295 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:49.147295 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:49.147295 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:49.147295 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:49.147295 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:49.147295 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:49.147295 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:49.147295 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:49.147295 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:49.147295 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:14:49.147295 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:49.147295 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 00:14:49.147295 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:49.147295 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 349/702] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Aug 24 00:14:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:49.152108 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a5b84-3275-46e1-ae70-cc606675b960 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:49.220935 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc97ab4-acf4-4d71-a49a-a8ec1750c6e6 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:49.252835 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:49.257151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a5b84-3275-46e1-ae70-cc606675b960 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:49.261767 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db24939-f207-4f0c-a369-0c4f30c01e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:49.263217 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db24939-f207-4f0c-a369-0c4f30c01e9b None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:49.263609 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db24939-f207-4f0c-a369-0c4f30c01e9b None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:49.263994 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db24939-f207-4f0c-a369-0c4f30c01e9b None admin] PATH_INFO: `/v3/services/network` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:49.264691 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db24939-f207-4f0c-a369-0c4f30c01e9b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:49.266321 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db24939-f207-4f0c-a369-0c4f30c01e9b None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:49.276984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-8db24939-f207-4f0c-a369-0c4f30c01e9b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 00:14:49.276984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:49.276984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:14:49.276984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:14:49.276984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:14:49.276984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:14:49.276984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:14:49.276984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:49.276984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 00:14:49.276984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:49.276984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:14:49.276984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:49.276984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:49.276984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:49.276984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:49.276984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:49.276984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:49.278029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:49.278029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:49.278029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:49.278029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:49.278029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:49.278029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:49.278029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:14:49.278029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:14:49.278029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:14:49.278029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:14:49.278029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:49.278029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:49.278029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:49.278029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:49.278029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:49.278029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:49.278887 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:49.278887 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:49.278887 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:49.278887 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:49.278887 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:49.278887 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:49.278887 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:49.278887 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:49.278887 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:49.278887 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:49.278887 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:14:49.278887 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:49.278887 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 00:14:49.278887 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:49.283603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:49.283812 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 354/703] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:49 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:49.284977 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db24939-f207-4f0c-a369-0c4f30c01e9b None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:49.294408 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecdb9a-a6c2-4f7e-bbed-0cfbaa085516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:49.294944 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecdb9a-a6c2-4f7e-bbed-0cfbaa085516 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:49.295265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecdb9a-a6c2-4f7e-bbed-0cfbaa085516 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:49.295537 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecdb9a-a6c2-4f7e-bbed-0cfbaa085516 None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:49.296168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aecdb9a-a6c2-4f7e-bbed-0cfbaa085516 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:49.296473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aecdb9a-a6c2-4f7e-bbed-0cfbaa085516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:49.297846 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aecdb9a-a6c2-4f7e-bbed-0cfbaa085516 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:49.302905 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 350/704] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 24 00:14:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:49.308481 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecdb9a-a6c2-4f7e-bbed-0cfbaa085516 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:49.416389 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db24939-f207-4f0c-a369-0c4f30c01e9b None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:49.435748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecdb9a-a6c2-4f7e-bbed-0cfbaa085516 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:49.456756 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac88d3-a8e4-4c77-9d7c-12590aba49ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:49.457954 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac88d3-a8e4-4c77-9d7c-12590aba49ab None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:49.458507 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac88d3-a8e4-4c77-9d7c-12590aba49ab None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:49.458986 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac88d3-a8e4-4c77-9d7c-12590aba49ab None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:49.459860 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac88d3-a8e4-4c77-9d7c-12590aba49ab None admin] RBAC: Adding query filter params (name=network) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:49.460468 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac88d3-a8e4-4c77-9d7c-12590aba49ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:49.462153 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac88d3-a8e4-4c77-9d7c-12590aba49ab None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:49.472292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13f9c2-69c2-40b5-b749-ce5cb662ac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:49.472725 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13f9c2-69c2-40b5-b749-ce5cb662ac12 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:49.472833 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 355/705] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 00:14:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:49.472995 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13f9c2-69c2-40b5-b749-ce5cb662ac12 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:49.473342 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13f9c2-69c2-40b5-b749-ce5cb662ac12 None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:49.474006 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13f9c2-69c2-40b5-b749-ce5cb662ac12 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:49.474309 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13f9c2-69c2-40b5-b749-ce5cb662ac12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:49.474821 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac88d3-a8e4-4c77-9d7c-12590aba49ab None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:49.475813 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13f9c2-69c2-40b5-b749-ce5cb662ac12 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:49.485665 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 351/706] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 24 00:14:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:49.487721 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13f9c2-69c2-40b5-b749-ce5cb662ac12 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:49.518986 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:49.566445 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:49.593436 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac88d3-a8e4-4c77-9d7c-12590aba49ab None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:49.631026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885ec81-66d4-4bb8-ba47-326aa647cf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:49.631671 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885ec81-66d4-4bb8-ba47-326aa647cf56 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:49.631981 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885ec81-66d4-4bb8-ba47-326aa647cf56 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:49.632260 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885ec81-66d4-4bb8-ba47-326aa647cf56 None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:49.633090 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885ec81-66d4-4bb8-ba47-326aa647cf56 None admin] RBAC: Adding query filter params (type=network) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:49.633210 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885ec81-66d4-4bb8-ba47-326aa647cf56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:49.634619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885ec81-66d4-4bb8-ba47-326aa647cf56 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:49.645463 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 356/707] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 00:14:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:49.645699 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13f9c2-69c2-40b5-b749-ce5cb662ac12 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:49.647986 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885ec81-66d4-4bb8-ba47-326aa647cf56 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:49.694175 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba590d7-42fd-4bb8-836b-baec03fa7580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:49.694809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba590d7-42fd-4bb8-836b-baec03fa7580 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:49.695124 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba590d7-42fd-4bb8-836b-baec03fa7580 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:49.695448 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba590d7-42fd-4bb8-836b-baec03fa7580 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:49.696270 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba590d7-42fd-4bb8-836b-baec03fa7580 None admin] RBAC: Adding query filter params (interface=public, service_id=89bea1258d504bbbb93d1383a88625c9, region_id=RegionOne) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:49.696590 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba590d7-42fd-4bb8-836b-baec03fa7580 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:49.697979 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba590d7-42fd-4bb8-836b-baec03fa7580 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:49.707858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 352/708] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 24 00:14:49 2022] GET /identity/v3/endpoints?service_id=89bea1258d504bbbb93d1383a88625c9&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:49.709467 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba590d7-42fd-4bb8-836b-baec03fa7580 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:49.778442 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:49.782830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885ec81-66d4-4bb8-ba47-326aa647cf56 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:49.822785 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277efd31-6e13-46f7-a100-d16adfc04963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:49.823379 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277efd31-6e13-46f7-a100-d16adfc04963 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:49.823804 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277efd31-6e13-46f7-a100-d16adfc04963 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:49.824182 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277efd31-6e13-46f7-a100-d16adfc04963 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:49.825171 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277efd31-6e13-46f7-a100-d16adfc04963 None admin] RBAC: Adding query filter params (interface=public, service_id=232278aebdef4607b4b3cf61b667668a, region_id=RegionOne) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:49.825738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277efd31-6e13-46f7-a100-d16adfc04963 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:49.827224 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277efd31-6e13-46f7-a100-d16adfc04963 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:49.841165 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 357/709] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 24 00:14:49 2022] GET /identity/v3/endpoints?service_id=232278aebdef4607b4b3cf61b667668a&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:49.844195 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277efd31-6e13-46f7-a100-d16adfc04963 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:49.855292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba590d7-42fd-4bb8-836b-baec03fa7580 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:49.873066 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:49.903721 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c952e-018f-4984-862f-95e868244f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:49.904724 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c952e-018f-4984-862f-95e868244f2e None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:49.905739 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c952e-018f-4984-862f-95e868244f2e None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:49.906220 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c952e-018f-4984-862f-95e868244f2e None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:49.907053 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c952e-018f-4984-862f-95e868244f2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:49.909529 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c952e-018f-4984-862f-95e868244f2e None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:49.923511 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 353/710] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 24 00:14:49 2022] GET /identity/v3/services => generated 1002 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 00:14:49.979944 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277efd31-6e13-46f7-a100-d16adfc04963 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:50.021252 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381cd1e-b239-4eee-943d-66dc734cb4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:50.021867 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381cd1e-b239-4eee-943d-66dc734cb4dd None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:50.022148 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381cd1e-b239-4eee-943d-66dc734cb4dd None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:50.022425 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381cd1e-b239-4eee-943d-66dc734cb4dd None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:50.023066 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381cd1e-b239-4eee-943d-66dc734cb4dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:50.024652 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381cd1e-b239-4eee-943d-66dc734cb4dd None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:50.031966 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 358/711] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 24 00:14:49 2022] GET /identity/v3/services => generated 1002 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 00:14:50.475788 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02e5cb-32b0-4305-b908-bf68bb03e555 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:50.476509 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02e5cb-32b0-4305-b908-bf68bb03e555 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:50.476509 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02e5cb-32b0-4305-b908-bf68bb03e555 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:50.478011 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 354/712] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:50.483615 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4ad23-c743-47c9-8a42-1ad0ce4a15fa None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:50.483899 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4ad23-c743-47c9-8a42-1ad0ce4a15fa None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:50.484177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4ad23-c743-47c9-8a42-1ad0ce4a15fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:50.503503 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-53d4ad23-c743-47c9-8a42-1ad0ce4a15fa None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:50.504682 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-53d4ad23-c743-47c9-8a42-1ad0ce4a15fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:50.535311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:50.585787 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 359/713] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:50 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:14:50.755310 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e3135-9c36-4344-8f37-2685f0030b39 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:50.755487 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e3135-9c36-4344-8f37-2685f0030b39 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:50.755761 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e3135-9c36-4344-8f37-2685f0030b39 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:50.757219 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 355/714] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:50.762873 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e446b-c28f-435d-9437-2c204011ff41 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:50.763790 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e446b-c28f-435d-9437-2c204011ff41 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:50.764290 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e446b-c28f-435d-9437-2c204011ff41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:50.784779 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-9a4e446b-c28f-435d-9437-2c204011ff41 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:50.786374 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-9a4e446b-c28f-435d-9437-2c204011ff41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:50.863005 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 360/715] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:50 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:14:50.940710 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e3135-9c36-4344-8f37-2685f0030b39 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.051612 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e3135-9c36-4344-8f37-2685f0030b39 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.088086 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fba32-7438-479f-b101-80e0986c63e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.088720 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fba32-7438-479f-b101-80e0986c63e0 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.089002 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fba32-7438-479f-b101-80e0986c63e0 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.089271 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fba32-7438-479f-b101-80e0986c63e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.100626 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fba32-7438-479f-b101-80e0986c63e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:14:51.105510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-d80fba32-7438-479f-b101-80e0986c63e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:51.105510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:51.105510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:51.105510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:51.105510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:51.105510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:51.105510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:51.105510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:51.105510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:51.105510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:51.105510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:51.105510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:51.105510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:14:51.105510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:14:51.105510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:14:51.105510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:14:51.107431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:14:51.107431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:14:51.107431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:14:51.107431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:14:51.107431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:51.107431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:51.107431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:51.107431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:51.107431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:51.107431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:51.107431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:51.107431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:51.107431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:51.107431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:51.107431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:51.107431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:51.108804 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:51.108804 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:51.108804 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:51.108804 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:51.108804 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:14:51.108804 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:14:51.108804 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:14:51.108804 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:14:51.108804 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:14:51.108804 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:14:51.108804 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:14:51.108804 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:51.108804 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 356/716] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 00:14:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:51.113525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e446b-c28f-435d-9437-2c204011ff41 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.205354 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fba32-7438-479f-b101-80e0986c63e0 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.206354 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:51.223896 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e446b-c28f-435d-9437-2c204011ff41 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.252464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:51.262798 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b08abc-0674-4b4b-9baa-4f837f7b2a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.263766 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b08abc-0674-4b4b-9baa-4f837f7b2a03 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.264193 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b08abc-0674-4b4b-9baa-4f837f7b2a03 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.264608 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b08abc-0674-4b4b-9baa-4f837f7b2a03 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.265436 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b08abc-0674-4b4b-9baa-4f837f7b2a03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:51.265890 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b08abc-0674-4b4b-9baa-4f837f7b2a03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:51.267741 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b08abc-0674-4b4b-9baa-4f837f7b2a03 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:51.277763 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 361/717] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:14:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:51.285888 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b08abc-0674-4b4b-9baa-4f837f7b2a03 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.322892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fba32-7438-479f-b101-80e0986c63e0 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.362210 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83de7b-8a8b-48c6-9882-6d722370a42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.362487 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83de7b-8a8b-48c6-9882-6d722370a42c None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.362621 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83de7b-8a8b-48c6-9882-6d722370a42c None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.362899 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83de7b-8a8b-48c6-9882-6d722370a42c None admin] PATH_INFO: `/v3/services/image` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.363548 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83de7b-8a8b-48c6-9882-6d722370a42c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:51.364939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83de7b-8a8b-48c6-9882-6d722370a42c None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:51.374855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-ee83de7b-8a8b-48c6-9882-6d722370a42c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 00:14:51.374855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:51.374855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:14:51.374855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:14:51.374855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:14:51.374855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:14:51.374855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:14:51.374855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:51.374855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 00:14:51.374855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:51.374855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:14:51.374855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:51.374855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:51.374855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:51.374855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:51.374855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:51.374855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:51.376042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:51.376042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:51.376042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:51.376042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:51.376042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:51.376042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:51.376042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:14:51.376042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:14:51.376042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:14:51.376042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:14:51.376042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:51.376042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:51.376042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:51.376042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:51.376042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:51.376042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:51.377005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:51.377005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:51.377005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:51.377005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:51.377005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:51.377005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:51.377005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:51.377005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:51.377005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:51.377005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:51.377005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:14:51.377005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:51.377005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 00:14:51.377005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:51.377005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 357/718] 10.222.0.42 () {56 vars in 1105 bytes} [Wed Aug 24 00:14:51 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:51.382753 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83de7b-8a8b-48c6-9882-6d722370a42c None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.399329 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b08abc-0674-4b4b-9baa-4f837f7b2a03 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.433668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe673f0-f010-4f42-a45d-32d8fe72c818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.435271 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe673f0-f010-4f42-a45d-32d8fe72c818 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.435715 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe673f0-f010-4f42-a45d-32d8fe72c818 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.436145 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe673f0-f010-4f42-a45d-32d8fe72c818 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.447386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe673f0-f010-4f42-a45d-32d8fe72c818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:51.448998 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe673f0-f010-4f42-a45d-32d8fe72c818 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:51.457435 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:51.463902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-dfe673f0-f010-4f42-a45d-32d8fe72c818 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:51.463902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:51.463902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:51.463902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:51.463902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:51.463902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:51.463902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:51.463902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:51.463902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:51.463902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:51.463902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:51.463902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:51.463902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:51.463902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:51.463902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:51.463902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:51.465026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:51.465026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:51.465026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:51.465026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:51.465026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:51.465026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:51.465026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:51.465026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:51.465026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:51.465026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:51.465026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:51.465026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:51.465026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:51.465026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:51.465026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:51.465026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:51.465026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:51.466586 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:51.466586 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:51.466586 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:51.472827 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 362/719] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:51.474045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe673f0-f010-4f42-a45d-32d8fe72c818 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.492871 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83de7b-8a8b-48c6-9882-6d722370a42c None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.503455 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:51.533873 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa38f21-d370-410b-a8b0-62e548e2e161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.534781 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa38f21-d370-410b-a8b0-62e548e2e161 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.535305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa38f21-d370-410b-a8b0-62e548e2e161 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.535723 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa38f21-d370-410b-a8b0-62e548e2e161 None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.536551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa38f21-d370-410b-a8b0-62e548e2e161 None admin] RBAC: Adding query filter params (name=image) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:51.537000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa38f21-d370-410b-a8b0-62e548e2e161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:51.538788 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa38f21-d370-410b-a8b0-62e548e2e161 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:51.549361 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 358/720] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:51.550733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa38f21-d370-410b-a8b0-62e548e2e161 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.587427 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe673f0-f010-4f42-a45d-32d8fe72c818 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.631914 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d0ad4-12c8-4e46-b510-d1eedd465573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.631914 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d0ad4-12c8-4e46-b510-d1eedd465573 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.631914 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d0ad4-12c8-4e46-b510-d1eedd465573 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.631914 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d0ad4-12c8-4e46-b510-d1eedd465573 None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.632333 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d0ad4-12c8-4e46-b510-d1eedd465573 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:51.632333 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d0ad4-12c8-4e46-b510-d1eedd465573 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:51.632333 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d0ad4-12c8-4e46-b510-d1eedd465573 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:51.643290 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 363/721] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:51.644631 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d0ad4-12c8-4e46-b510-d1eedd465573 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.663488 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa38f21-d370-410b-a8b0-62e548e2e161 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.707839 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d6375-dcb2-4405-9935-b68d2872146d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.708528 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d6375-dcb2-4405-9935-b68d2872146d None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.708810 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d6375-dcb2-4405-9935-b68d2872146d None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.709087 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d6375-dcb2-4405-9935-b68d2872146d None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.709768 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d6375-dcb2-4405-9935-b68d2872146d None admin] RBAC: Adding query filter params (type=image) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:51.710076 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d6375-dcb2-4405-9935-b68d2872146d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:51.711556 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d6375-dcb2-4405-9935-b68d2872146d None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:51.722319 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:51.722502 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 359/722] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:51.723303 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d6375-dcb2-4405-9935-b68d2872146d None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:51.761369 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:51.778414 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d0ad4-12c8-4e46-b510-d1eedd465573 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.849918 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d6375-dcb2-4405-9935-b68d2872146d None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:51.891492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be6d24-5c75-43d9-b857-f91afc081332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.892482 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be6d24-5c75-43d9-b857-f91afc081332 None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.892983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be6d24-5c75-43d9-b857-f91afc081332 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.893446 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be6d24-5c75-43d9-b857-f91afc081332 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.894309 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be6d24-5c75-43d9-b857-f91afc081332 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:51.895944 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be6d24-5c75-43d9-b857-f91afc081332 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:51.926135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 360/723] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 00:14:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:14:51.954501 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e9b2d-0b1f-41f6-bc4d-840d82fce3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:51.955592 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e9b2d-0b1f-41f6-bc4d-840d82fce3a5 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:51.956135 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e9b2d-0b1f-41f6-bc4d-840d82fce3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:51.956636 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e9b2d-0b1f-41f6-bc4d-840d82fce3a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:51.967029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e9b2d-0b1f-41f6-bc4d-840d82fce3a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:51.969110 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e9b2d-0b1f-41f6-bc4d-840d82fce3a5 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:51.983512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-c28e9b2d-0b1f-41f6-bc4d-840d82fce3a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:14:51.983512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:51.983512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:51.983512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:51.983512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:51.983512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:51.983512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:51.983512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:51.983512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:51.983512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:51.983512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:51.983512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:51.983512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:14:51.983512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:14:51.983512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:14:51.983512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:14:51.984523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:51.984523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:51.984523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:14:51.984523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:51.984523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:14:51.984523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:14:51.984523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:51.984523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:51.984523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:51.984523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:51.984523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:51.984523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:51.984523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:51.984523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:51.984523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:51.984523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:51.984523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:51.984523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:51.985491 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:51.985491 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:51.985491 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:14:51.985491 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:14:51.985491 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:14:51.985491 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:14:51.985491 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:14:51.985491 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:14:51.985491 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 00:14:51.985491 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:14:51.989181 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 364/724] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 24 00:14:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:51.996083 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be6d24-5c75-43d9-b857-f91afc081332 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:52.101650 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:52.122300 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be6d24-5c75-43d9-b857-f91afc081332 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:52.159957 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877d381-ea50-493f-9ce3-43bac3515fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:52.160614 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877d381-ea50-493f-9ce3-43bac3515fa8 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:52.160892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877d381-ea50-493f-9ce3-43bac3515fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:52.161161 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877d381-ea50-493f-9ce3-43bac3515fa8 None admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:52.161878 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877d381-ea50-493f-9ce3-43bac3515fa8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:52.162179 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877d381-ea50-493f-9ce3-43bac3515fa8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:52.163637 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877d381-ea50-493f-9ce3-43bac3515fa8 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:52.181733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 361/725] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 24 00:14:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:52.187199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e9b2d-0b1f-41f6-bc4d-840d82fce3a5 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:52.280731 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c77bc5-a3d9-4ff4-9db7-283944e7c3a4 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:52.281431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c77bc5-a3d9-4ff4-9db7-283944e7c3a4 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:52.281948 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c77bc5-a3d9-4ff4-9db7-283944e7c3a4 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:52.284038 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 362/726] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:14:52.289444 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c9e76-e466-4db3-81fd-e825b0b0cf06 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:52.289768 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c9e76-e466-4db3-81fd-e825b0b0cf06 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:52.290003 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c9e76-e466-4db3-81fd-e825b0b0cf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:52.301783 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e9b2d-0b1f-41f6-bc4d-840d82fce3a5 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:52.308742 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-b52c9e76-e466-4db3-81fd-e825b0b0cf06 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:52.310598 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-b52c9e76-e466-4db3-81fd-e825b0b0cf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:52.319653 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:52.340981 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112f371-e27f-4f83-9ec3-3a1aaf7330aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:52.341583 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112f371-e27f-4f83-9ec3-3a1aaf7330aa None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:52.341856 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112f371-e27f-4f83-9ec3-3a1aaf7330aa None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:52.342123 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112f371-e27f-4f83-9ec3-3a1aaf7330aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:52.411234 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 363/727] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:52 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:14:52.428339 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3833aeb-56c7-4df9-b118-9881ed60c6ab None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:52.428842 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3833aeb-56c7-4df9-b118-9881ed60c6ab None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:52.429256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3833aeb-56c7-4df9-b118-9881ed60c6ab None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:52.430745 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 364/728] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:14:52.432707 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112f371-e27f-4f83-9ec3-3a1aaf7330aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:52.434886 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112f371-e27f-4f83-9ec3-3a1aaf7330aa None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:52.436873 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b11fd2-be1c-4e95-bc04-27dce4e50b9f None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:52.437631 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b11fd2-be1c-4e95-bc04-27dce4e50b9f None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:52.438024 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b11fd2-be1c-4e95-bc04-27dce4e50b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:52.457420 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-b0b11fd2-be1c-4e95-bc04-27dce4e50b9f None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:52.458851 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-b0b11fd2-be1c-4e95-bc04-27dce4e50b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:52.539448 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 365/729] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:52 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 00:14:52.555864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 365/730] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:52 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 00:14:52.562728 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b11fd2-be1c-4e95-bc04-27dce4e50b9f None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:52.570466 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:52.666191 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b11fd2-be1c-4e95-bc04-27dce4e50b9f None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:52.702128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8e871-78e1-4605-a43c-2fc42e41e7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:52.703028 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8e871-78e1-4605-a43c-2fc42e41e7b9 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:52.703321 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8e871-78e1-4605-a43c-2fc42e41e7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:52.703594 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8e871-78e1-4605-a43c-2fc42e41e7b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:52.714449 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8e871-78e1-4605-a43c-2fc42e41e7b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:52.715984 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8e871-78e1-4605-a43c-2fc42e41e7b9 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:52.730662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-48c8e871-78e1-4605-a43c-2fc42e41e7b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:52.730662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:52.730662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:52.730662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:52.730662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:52.730662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:52.730662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:52.730662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:52.730662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:52.730662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:52.730662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:52.730662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:52.730662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:52.730662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:52.730662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:52.730662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:52.734069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:52.734069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:52.734069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:52.734069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:52.734069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:52.734069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:52.734069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:52.734069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:52.734069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:52.734069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:52.734069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:52.734069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:52.734069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:52.734069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:52.734069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:52.734069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:52.734069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:52.734946 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:52.734946 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:52.734946 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:52.734946 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 366/731] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:52.742557 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112f371-e27f-4f83-9ec3-3a1aaf7330aa None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:52.750734 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8e871-78e1-4605-a43c-2fc42e41e7b9 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:52.762600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:52.819471 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:52.853207 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112f371-e27f-4f83-9ec3-3a1aaf7330aa None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:52.853727 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8e871-78e1-4605-a43c-2fc42e41e7b9 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:52.890175 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287d288-d15c-4ed8-a5f4-f9ee322ac7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:52.890797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287d288-d15c-4ed8-a5f4-f9ee322ac7ba None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:52.891107 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287d288-d15c-4ed8-a5f4-f9ee322ac7ba None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:52.891237 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07373e8a-4461-4ff1-83a0-11c386118be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:52.891477 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287d288-d15c-4ed8-a5f4-f9ee322ac7ba None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:52.891752 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07373e8a-4461-4ff1-83a0-11c386118be0 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:52.891957 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287d288-d15c-4ed8-a5f4-f9ee322ac7ba None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:52.892053 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07373e8a-4461-4ff1-83a0-11c386118be0 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:52.892290 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07373e8a-4461-4ff1-83a0-11c386118be0 None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:52.892921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07373e8a-4461-4ff1-83a0-11c386118be0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:52.893223 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07373e8a-4461-4ff1-83a0-11c386118be0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:52.893392 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287d288-d15c-4ed8-a5f4-f9ee322ac7ba None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:52.894577 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07373e8a-4461-4ff1-83a0-11c386118be0 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:52.903671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-7287d288-d15c-4ed8-a5f4-f9ee322ac7ba None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 00:14:52.903671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:52.903671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:14:52.903671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:14:52.903671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:14:52.903671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:14:52.903671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:14:52.903671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:52.903671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 00:14:52.903671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:52.903671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:14:52.903671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:52.903671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:52.903671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:52.903671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:52.903671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:52.903671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:52.904613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:52.904613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:52.904613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:52.904613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:52.904613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:52.904613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:52.904613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:14:52.904613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:14:52.904613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:14:52.904613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:14:52.904613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:52.904613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:52.904613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:52.904613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:52.904613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:52.904613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:52.905480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:52.905480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:52.905480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:52.905480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:52.905480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:52.905480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:52.905480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:52.905480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:52.905480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:52.905480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:52.905480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:14:52.905480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:52.905480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 00:14:52.905480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:52.905480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 367/732] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Aug 24 00:14:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:14:52.911562 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287d288-d15c-4ed8-a5f4-f9ee322ac7ba None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:52.911668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 366/733] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:52.913358 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07373e8a-4461-4ff1-83a0-11c386118be0 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:53.003027 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:53.019225 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287d288-d15c-4ed8-a5f4-f9ee322ac7ba None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:53.030802 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07373e8a-4461-4ff1-83a0-11c386118be0 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:53.041331 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:53.056649 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63107085-cc10-43a8-ab34-da787a3ffea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:53.057368 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63107085-cc10-43a8-ab34-da787a3ffea0 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:53.057654 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63107085-cc10-43a8-ab34-da787a3ffea0 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:53.057920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63107085-cc10-43a8-ab34-da787a3ffea0 None admin] PATH_INFO: `/v3/services/network` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:53.058509 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63107085-cc10-43a8-ab34-da787a3ffea0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:53.059923 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63107085-cc10-43a8-ab34-da787a3ffea0 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:53.069184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c96b5-6f73-4c1d-9f2f-69475dd69999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:53.069800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-63107085-cc10-43a8-ab34-da787a3ffea0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 00:14:53.069800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:53.069800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:14:53.069800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:14:53.069800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:14:53.069800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:14:53.069800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:14:53.069800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:53.069800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 00:14:53.069800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:53.069800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:14:53.069800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:53.069800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:53.069800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:53.069800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:53.069800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:53.069800 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:53.070786 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:53.070786 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:53.070786 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:53.070786 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:53.070786 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:53.070786 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:53.070786 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:14:53.070786 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:14:53.070786 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:14:53.070786 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:14:53.070786 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:53.070786 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:53.070786 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:53.070786 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:53.070786 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:53.070786 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:53.071667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:53.071667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:53.071667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:53.071667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:53.071667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:53.071667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:53.071667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:53.071667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:53.071667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:53.071667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:53.071667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:14:53.071667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:53.071667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 00:14:53.071667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:53.071667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 368/734] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:52 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:53.072461 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63107085-cc10-43a8-ab34-da787a3ffea0 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:53.073384 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c96b5-6f73-4c1d-9f2f-69475dd69999 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:53.073669 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c96b5-6f73-4c1d-9f2f-69475dd69999 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:53.073938 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c96b5-6f73-4c1d-9f2f-69475dd69999 None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:53.074577 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c96b5-6f73-4c1d-9f2f-69475dd69999 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:53.074879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c96b5-6f73-4c1d-9f2f-69475dd69999 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:53.076355 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c96b5-6f73-4c1d-9f2f-69475dd69999 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:53.083034 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 367/735] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 24 00:14:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:53.083565 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c96b5-6f73-4c1d-9f2f-69475dd69999 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:53.185992 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63107085-cc10-43a8-ab34-da787a3ffea0 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:53.193197 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c96b5-6f73-4c1d-9f2f-69475dd69999 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:53.222444 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4f311-b5fc-4144-b047-c5cfba34f88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:53.223035 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4f311-b5fc-4144-b047-c5cfba34f88b None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:53.223320 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4f311-b5fc-4144-b047-c5cfba34f88b None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:53.223588 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4f311-b5fc-4144-b047-c5cfba34f88b None admin] PATH_INFO: `/v3/projects/service` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:53.231614 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4f311-b5fc-4144-b047-c5cfba34f88b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:53.231911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e71fac-0d2d-428a-a9fc-74525f166c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:53.232510 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e71fac-0d2d-428a-a9fc-74525f166c9b None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:53.232791 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e71fac-0d2d-428a-a9fc-74525f166c9b None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:53.233067 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e71fac-0d2d-428a-a9fc-74525f166c9b None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:53.233162 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4f311-b5fc-4144-b047-c5cfba34f88b None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:53.233694 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e71fac-0d2d-428a-a9fc-74525f166c9b None admin] RBAC: Adding query filter params (name=network) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:53.233998 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e71fac-0d2d-428a-a9fc-74525f166c9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:53.235581 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e71fac-0d2d-428a-a9fc-74525f166c9b None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:53.240584 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 368/736] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 00:14:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:53.241212 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e71fac-0d2d-428a-a9fc-74525f166c9b None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:53.248137 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:53.248737 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-0ef4f311-b5fc-4144-b047-c5cfba34f88b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:53.248737 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:53.248737 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:53.248737 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:53.248737 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:53.248737 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:53.248737 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:53.248737 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:53.248737 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:53.248737 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:53.248737 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:53.248737 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:53.248737 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:14:53.248737 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:14:53.248737 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:14:53.249642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:14:53.249642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:53.249642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:53.249642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:53.249642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:53.249642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:53.249642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:53.249642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:53.249642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:53.249642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:53.249642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:53.249642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:53.249642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:53.249642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:53.249642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:53.249642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:53.249642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:53.250763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:14:53.250763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:14:53.250763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:14:53.250763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:14:53.250763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:14:53.250763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:14:53.250763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:14:53.250763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:53.252858 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 369/737] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:53.253895 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4f311-b5fc-4144-b047-c5cfba34f88b None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:53.307464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:53.349368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e71fac-0d2d-428a-a9fc-74525f166c9b None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:53.374888 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4f311-b5fc-4144-b047-c5cfba34f88b None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:53.385598 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bc5cd-bc8b-4395-82e2-6d04913e5caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:53.386371 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bc5cd-bc8b-4395-82e2-6d04913e5caf None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:53.386829 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bc5cd-bc8b-4395-82e2-6d04913e5caf None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:53.387840 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bc5cd-bc8b-4395-82e2-6d04913e5caf None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:53.388610 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bc5cd-bc8b-4395-82e2-6d04913e5caf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:53.389060 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bc5cd-bc8b-4395-82e2-6d04913e5caf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:53.390567 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bc5cd-bc8b-4395-82e2-6d04913e5caf None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:53.396203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 369/738] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 24 00:14:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:53.397144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bc5cd-bc8b-4395-82e2-6d04913e5caf None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:53.416734 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1eb91-8f53-44d5-94a6-923d57db54f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:53.417333 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1eb91-8f53-44d5-94a6-923d57db54f8 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:53.417612 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1eb91-8f53-44d5-94a6-923d57db54f8 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:53.417883 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1eb91-8f53-44d5-94a6-923d57db54f8 None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:53.418533 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1eb91-8f53-44d5-94a6-923d57db54f8 None admin] RBAC: Adding query filter params (type=network) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:53.418833 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1eb91-8f53-44d5-94a6-923d57db54f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:53.420234 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1eb91-8f53-44d5-94a6-923d57db54f8 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:53.431217 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 370/739] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 00:14:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:53.432210 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1eb91-8f53-44d5-94a6-923d57db54f8 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:53.471794 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:53.506783 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bc5cd-bc8b-4395-82e2-6d04913e5caf None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:53.547108 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf95a5-530d-43eb-9a95-0edd641c0a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:53.547701 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1eb91-8f53-44d5-94a6-923d57db54f8 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:53.548128 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf95a5-530d-43eb-9a95-0edd641c0a35 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:53.548128 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf95a5-530d-43eb-9a95-0edd641c0a35 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:53.548276 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf95a5-530d-43eb-9a95-0edd641c0a35 None admin] PATH_INFO: `/v3/projects` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:53.548929 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf95a5-530d-43eb-9a95-0edd641c0a35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:53.549408 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf95a5-530d-43eb-9a95-0edd641c0a35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:53.551724 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf95a5-530d-43eb-9a95-0edd641c0a35 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:53.556965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:53.572063 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 370/740] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:14:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:53.572063 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf95a5-530d-43eb-9a95-0edd641c0a35 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:53.587845 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec082c8-9e0a-4b4d-a5e3-754a65f6f090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:53.589032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec082c8-9e0a-4b4d-a5e3-754a65f6f090 None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:53.589767 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec082c8-9e0a-4b4d-a5e3-754a65f6f090 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:53.590193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec082c8-9e0a-4b4d-a5e3-754a65f6f090 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:53.591820 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec082c8-9e0a-4b4d-a5e3-754a65f6f090 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:53.593691 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec082c8-9e0a-4b4d-a5e3-754a65f6f090 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:53.617744 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 371/741] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 00:14:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:14:53.618607 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec082c8-9e0a-4b4d-a5e3-754a65f6f090 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:53.708504 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf95a5-530d-43eb-9a95-0edd641c0a35 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:53.739626 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:53.750317 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec082c8-9e0a-4b4d-a5e3-754a65f6f090 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:53.751647 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53110b8a-7b74-4652-9428-03e8790c7ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:53.752501 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53110b8a-7b74-4652-9428-03e8790c7ede None admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:53.753018 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53110b8a-7b74-4652-9428-03e8790c7ede None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:53.753510 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53110b8a-7b74-4652-9428-03e8790c7ede None admin] PATH_INFO: `/v3/endpoints` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:53.754412 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53110b8a-7b74-4652-9428-03e8790c7ede None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:53.756179 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53110b8a-7b74-4652-9428-03e8790c7ede None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:53.784019 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 371/742] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 00:14:53 2022] POST /identity/v3/endpoints => generated 337 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:14:53.810672 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f9ade-905a-4894-9628-dca3b78d33fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:53.811699 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f9ade-905a-4894-9628-dca3b78d33fe None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:53.812244 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f9ade-905a-4894-9628-dca3b78d33fe None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:53.812999 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f9ade-905a-4894-9628-dca3b78d33fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:53.814074 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f9ade-905a-4894-9628-dca3b78d33fe None admin] RBAC: Adding query filter params (role.id=9b372d4fe82a4a54a3ecd29e7b912586, scope.project.id=a63a68d37106431e80bd876cdce3e5fa, user.id=a863e95438d14892816e4f3c94673025) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:53.814633 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f9ade-905a-4894-9628-dca3b78d33fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:53.816477 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f9ade-905a-4894-9628-dca3b78d33fe None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:53.829830 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 372/743] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:14:53 2022] GET /identity/v3/role_assignments?user.id=a863e95438d14892816e4f3c94673025&scope.project.id=a63a68d37106431e80bd876cdce3e5fa&role.id=9b372d4fe82a4a54a3ecd29e7b912586 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:54.300391 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dc728-de35-4b9a-8e18-a5ddbe578e29 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:54.300917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dc728-de35-4b9a-8e18-a5ddbe578e29 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:54.300917 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dc728-de35-4b9a-8e18-a5ddbe578e29 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:54.302409 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 372/744] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:54.307496 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8ce9-091b-4ab6-8081-84ec9b22ef30 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:54.307780 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8ce9-091b-4ab6-8081-84ec9b22ef30 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:54.308048 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8ce9-091b-4ab6-8081-84ec9b22ef30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:54.326930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-edcf8ce9-091b-4ab6-8081-84ec9b22ef30 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:54.328126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-edcf8ce9-091b-4ab6-8081-84ec9b22ef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:54.343637 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:54.400288 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 373/745] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:54 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:14:54.720231 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dc728-de35-4b9a-8e18-a5ddbe578e29 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:54.829335 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dc728-de35-4b9a-8e18-a5ddbe578e29 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:54.862864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bab0a-9969-4cad-986c-e1e557dfa3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:54.863511 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bab0a-9969-4cad-986c-e1e557dfa3b6 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:54.863763 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bab0a-9969-4cad-986c-e1e557dfa3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:54.864039 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bab0a-9969-4cad-986c-e1e557dfa3b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:54.915611 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:54.933957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bab0a-9969-4cad-986c-e1e557dfa3b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:54.935970 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bab0a-9969-4cad-986c-e1e557dfa3b6 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:55.038387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 373/746] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:14:54 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 00:14:55.044428 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8ce9-091b-4ab6-8081-84ec9b22ef30 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:55.265955 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8ce9-091b-4ab6-8081-84ec9b22ef30 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:55.300571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d049e-a328-40b6-a6ea-afb00d7cf532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:55.301115 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d049e-a328-40b6-a6ea-afb00d7cf532 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:55.301390 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d049e-a328-40b6-a6ea-afb00d7cf532 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:55.301660 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d049e-a328-40b6-a6ea-afb00d7cf532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:55.311801 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d049e-a328-40b6-a6ea-afb00d7cf532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:55.313511 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d049e-a328-40b6-a6ea-afb00d7cf532 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:55.327518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-c96d049e-a328-40b6-a6ea-afb00d7cf532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:55.327518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:55.327518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:55.327518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:55.327518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:55.327518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:55.327518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:55.327518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:55.327518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:55.327518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:55.327518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:55.327518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:55.327518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:14:55.327518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:14:55.327518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:14:55.327518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:14:55.328470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:55.328470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:55.328470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:55.328470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:55.328470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:55.328470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:55.328470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:55.328470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:55.328470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:55.328470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:55.328470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:55.328470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:55.328470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:55.328470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:55.328470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:55.328470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:55.328470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:14:55.329370 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:14:55.329370 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:14:55.329370 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:55.330090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 374/747] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:55.334445 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bab0a-9969-4cad-986c-e1e557dfa3b6 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:55.421100 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:55.437775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bab0a-9969-4cad-986c-e1e557dfa3b6 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:55.472250 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544be0d-fb09-4050-9a7b-d9a3030e5102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:55.472845 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544be0d-fb09-4050-9a7b-d9a3030e5102 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:55.473123 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544be0d-fb09-4050-9a7b-d9a3030e5102 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:55.473394 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544be0d-fb09-4050-9a7b-d9a3030e5102 None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:55.474032 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544be0d-fb09-4050-9a7b-d9a3030e5102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:55.474334 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544be0d-fb09-4050-9a7b-d9a3030e5102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:55.475734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544be0d-fb09-4050-9a7b-d9a3030e5102 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:55.488200 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 374/748] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:55.905402 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d8327-723e-42ab-80de-f1b354a8d658 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:55.905798 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d8327-723e-42ab-80de-f1b354a8d658 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:55.906072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d8327-723e-42ab-80de-f1b354a8d658 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:55.907433 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 375/749] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:14:55.912827 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd99fb0-bd7d-48fa-aec3-dbd579dddf5e None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:55.913114 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd99fb0-bd7d-48fa-aec3-dbd579dddf5e None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:55.913386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd99fb0-bd7d-48fa-aec3-dbd579dddf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:55.931207 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-ebd99fb0-bd7d-48fa-aec3-dbd579dddf5e None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:55.932386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-ebd99fb0-bd7d-48fa-aec3-dbd579dddf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:56.002880 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 375/750] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:55 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:14:56.107980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920256d1-5625-4be0-98a0-1532e89b43f2 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:56.108533 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920256d1-5625-4be0-98a0-1532e89b43f2 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:56.108533 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920256d1-5625-4be0-98a0-1532e89b43f2 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:56.109818 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 376/751] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:56.115166 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948cef2-9115-4589-94b3-6147d68a51c2 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:56.115456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948cef2-9115-4589-94b3-6147d68a51c2 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:56.115757 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948cef2-9115-4589-94b3-6147d68a51c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:56.133992 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-1948cef2-9115-4589-94b3-6147d68a51c2 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:56.135196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-1948cef2-9115-4589-94b3-6147d68a51c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:56.200776 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 376/752] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:56 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:14:56.327125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920256d1-5625-4be0-98a0-1532e89b43f2 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:56.330109 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:56.426592 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920256d1-5625-4be0-98a0-1532e89b43f2 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:56.460099 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb5a55-ec3b-4afb-81b0-41f9369ebb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:56.460641 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb5a55-ec3b-4afb-81b0-41f9369ebb27 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:56.460915 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb5a55-ec3b-4afb-81b0-41f9369ebb27 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:56.461182 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb5a55-ec3b-4afb-81b0-41f9369ebb27 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:56.461758 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb5a55-ec3b-4afb-81b0-41f9369ebb27 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:56.463156 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb5a55-ec3b-4afb-81b0-41f9369ebb27 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:56.471880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-4dbb5a55-ec3b-4afb-81b0-41f9369ebb27 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 00:14:56.471880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:56.471880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:14:56.471880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:14:56.471880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:14:56.471880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:14:56.471880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:14:56.471880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:56.471880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 00:14:56.471880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:56.471880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:14:56.471880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:56.471880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:56.471880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:56.471880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:56.471880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:56.471880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:56.472852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:56.472852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:56.472852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:56.472852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:56.472852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:56.472852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:56.472852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:14:56.472852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:14:56.472852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:14:56.472852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:14:56.472852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:56.472852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:56.472852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:56.472852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:56.472852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:56.472852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:56.473664 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:56.473664 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:56.473664 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:56.473664 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:56.473664 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:56.473664 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:56.473664 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:56.473664 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:56.473664 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:56.473664 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:56.473664 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:14:56.473664 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:56.473664 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 00:14:56.473664 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:56.475157 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 377/753] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:14:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:56.479020 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948cef2-9115-4589-94b3-6147d68a51c2 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:56.483138 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:56.532671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb5a55-ec3b-4afb-81b0-41f9369ebb27 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:56.583459 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948cef2-9115-4589-94b3-6147d68a51c2 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:56.598892 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:56.618129 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f84c0-5564-47a2-91eb-4a2dfd6bf4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:56.618941 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f84c0-5564-47a2-91eb-4a2dfd6bf4c4 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:56.619259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f84c0-5564-47a2-91eb-4a2dfd6bf4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:56.619539 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f84c0-5564-47a2-91eb-4a2dfd6bf4c4 None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:56.620197 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f84c0-5564-47a2-91eb-4a2dfd6bf4c4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:56.620506 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f84c0-5564-47a2-91eb-4a2dfd6bf4c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:56.622612 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f84c0-5564-47a2-91eb-4a2dfd6bf4c4 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:56.627110 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 377/754] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:14:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:56.632690 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f84c0-5564-47a2-91eb-4a2dfd6bf4c4 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:56.634156 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb5a55-ec3b-4afb-81b0-41f9369ebb27 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:56.671587 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60483b2-7f3b-42dd-bf54-e2efeff89a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:56.672203 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60483b2-7f3b-42dd-bf54-e2efeff89a55 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:56.672478 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60483b2-7f3b-42dd-bf54-e2efeff89a55 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:56.672744 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60483b2-7f3b-42dd-bf54-e2efeff89a55 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:56.673315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60483b2-7f3b-42dd-bf54-e2efeff89a55 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:56.674821 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60483b2-7f3b-42dd-bf54-e2efeff89a55 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:56.683244 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-d60483b2-7f3b-42dd-bf54-e2efeff89a55 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 00:14:56.683244 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:56.683244 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:14:56.683244 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:14:56.683244 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:14:56.683244 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:14:56.683244 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:14:56.683244 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:56.683244 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 00:14:56.683244 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:56.683244 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:14:56.683244 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:56.683244 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:14:56.683244 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:14:56.683244 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:14:56.683244 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:14:56.684792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:14:56.684792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:14:56.684792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:14:56.684792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:14:56.684792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:14:56.684792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:14:56.684792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:14:56.684792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:14:56.684792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:14:56.684792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:14:56.684792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:14:56.684792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:14:56.684792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:14:56.684792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:14:56.684792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:14:56.684792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:14:56.684792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:14:56.685681 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:14:56.685681 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:14:56.685681 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:14:56.685681 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:14:56.685681 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:14:56.685681 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:14:56.685681 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:14:56.685681 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:14:56.685681 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:14:56.685681 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:14:56.685681 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:14:56.685681 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:14:56.685681 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 00:14:56.685681 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:14:56.685681 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 378/755] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Aug 24 00:14:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:14:56.691162 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60483b2-7f3b-42dd-bf54-e2efeff89a55 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:56.704700 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:56.738445 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f84c0-5564-47a2-91eb-4a2dfd6bf4c4 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:56.772734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4fff2-0966-4b00-8ee9-d69a307b4649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:56.773321 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4fff2-0966-4b00-8ee9-d69a307b4649 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:56.773597 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4fff2-0966-4b00-8ee9-d69a307b4649 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:56.773863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4fff2-0966-4b00-8ee9-d69a307b4649 None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:56.774483 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4fff2-0966-4b00-8ee9-d69a307b4649 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:56.774780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4fff2-0966-4b00-8ee9-d69a307b4649 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:56.776179 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4fff2-0966-4b00-8ee9-d69a307b4649 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:56.781134 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 378/756] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:14:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:56.789927 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60483b2-7f3b-42dd-bf54-e2efeff89a55 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:56.822467 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:56.829650 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee61706-7b9c-465d-a0ea-b0c815e63db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:56.830258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee61706-7b9c-465d-a0ea-b0c815e63db4 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:56.830534 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee61706-7b9c-465d-a0ea-b0c815e63db4 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:56.830802 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee61706-7b9c-465d-a0ea-b0c815e63db4 None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:56.831469 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee61706-7b9c-465d-a0ea-b0c815e63db4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:56.831773 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee61706-7b9c-465d-a0ea-b0c815e63db4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:56.833166 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee61706-7b9c-465d-a0ea-b0c815e63db4 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:56.838498 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 379/757] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 24 00:14:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:14:56.844614 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4fff2-0966-4b00-8ee9-d69a307b4649 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:56.950254 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4fff2-0966-4b00-8ee9-d69a307b4649 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:56.982511 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:56.987939 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a3930-bf2b-4a3a-bfa2-cd8842d5e4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:56.988611 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a3930-bf2b-4a3a-bfa2-cd8842d5e4aa None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:56.988839 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a3930-bf2b-4a3a-bfa2-cd8842d5e4aa None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:56.989106 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a3930-bf2b-4a3a-bfa2-cd8842d5e4aa None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:56.989736 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a3930-bf2b-4a3a-bfa2-cd8842d5e4aa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:14:56.990035 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a3930-bf2b-4a3a-bfa2-cd8842d5e4aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:56.991464 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a3930-bf2b-4a3a-bfa2-cd8842d5e4aa None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:56.995892 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 379/758] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 24 00:14:56 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:14:58.985845 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4f4d7-6049-4d0d-8c80-aa9fda763660 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:58.986370 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4f4d7-6049-4d0d-8c80-aa9fda763660 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:58.986370 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4f4d7-6049-4d0d-8c80-aa9fda763660 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:58.987701 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 380/759] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:58.993702 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004804-31c9-4812-ada4-594494febf90 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:58.994227 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004804-31c9-4812-ada4-594494febf90 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:58.994227 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004804-31c9-4812-ada4-594494febf90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:59.013823 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-ed004804-31c9-4812-ada4-594494febf90 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:59.015234 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-ed004804-31c9-4812-ada4-594494febf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:59.082118 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 380/760] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:58 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:14:59.136245 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653dcb3-1bd3-47f2-9b17-a17bb9542603 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:59.136528 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653dcb3-1bd3-47f2-9b17-a17bb9542603 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:59.136852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653dcb3-1bd3-47f2-9b17-a17bb9542603 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:59.138158 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 381/761] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:14:59.143710 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65eb533-38f7-4949-8edb-c0b8c40a859d None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:59.143997 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65eb533-38f7-4949-8edb-c0b8c40a859d None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:59.144271 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65eb533-38f7-4949-8edb-c0b8c40a859d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:59.162259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-b65eb533-38f7-4949-8edb-c0b8c40a859d None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:14:59.163457 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-b65eb533-38f7-4949-8edb-c0b8c40a859d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:14:59.227061 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 381/762] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:14:59 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:14:59.410797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653dcb3-1bd3-47f2-9b17-a17bb9542603 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:59.510122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653dcb3-1bd3-47f2-9b17-a17bb9542603 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:59.545915 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e587ce-6ff4-493d-93ca-94d77f32a7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:59.546775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65eb533-38f7-4949-8edb-c0b8c40a859d None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:14:59.546906 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e587ce-6ff4-493d-93ca-94d77f32a7dc None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:59.547149 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e587ce-6ff4-493d-93ca-94d77f32a7dc None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:59.547420 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e587ce-6ff4-493d-93ca-94d77f32a7dc None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:59.548059 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e587ce-6ff4-493d-93ca-94d77f32a7dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:59.549457 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e587ce-6ff4-493d-93ca-94d77f32a7dc None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:59.564161 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 382/763] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 00:14:59 2022] POST /identity/v3/services => generated 251 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:14:59.610299 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:14:59.657949 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65eb533-38f7-4949-8edb-c0b8c40a859d None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:14:59.702389 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e600b6-531f-4ee1-8616-c751f5f6caed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:14:59.703050 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e600b6-531f-4ee1-8616-c751f5f6caed None admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:14:59.703334 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e600b6-531f-4ee1-8616-c751f5f6caed None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:14:59.703632 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e600b6-531f-4ee1-8616-c751f5f6caed None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:14:59.704284 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e600b6-531f-4ee1-8616-c751f5f6caed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:14:59.705686 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e600b6-531f-4ee1-8616-c751f5f6caed None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:14:59.722425 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 382/764] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 00:14:59 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:15:01.762870 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d06df-cbdc-4eeb-8018-463349666b0c None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:01.763443 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d06df-cbdc-4eeb-8018-463349666b0c None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:01.763443 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d06df-cbdc-4eeb-8018-463349666b0c None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:01.764799 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 383/765] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:01.770931 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35207888-4994-4c1e-9bec-075ff9ecb5c2 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:01.771467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35207888-4994-4c1e-9bec-075ff9ecb5c2 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:01.771467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35207888-4994-4c1e-9bec-075ff9ecb5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:01.789818 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-35207888-4994-4c1e-9bec-075ff9ecb5c2 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:01.791013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-35207888-4994-4c1e-9bec-075ff9ecb5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:01.863238 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 383/766] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:01 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:15:01.908394 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71751d98-16a5-4666-9929-adf46265c091 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:01.908740 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71751d98-16a5-4666-9929-adf46265c091 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:01.909221 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71751d98-16a5-4666-9929-adf46265c091 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:01.910271 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 384/767] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:01.915569 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8fb6c-8e47-46ce-a851-3652c30676b7 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:01.915861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8fb6c-8e47-46ce-a851-3652c30676b7 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:01.916137 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8fb6c-8e47-46ce-a851-3652c30676b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:01.933848 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-c7c8fb6c-8e47-46ce-a851-3652c30676b7 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:01.935055 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-c7c8fb6c-8e47-46ce-a851-3652c30676b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:01.966227 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:02.004522 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 384/768] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:01 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:15:02.185595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71751d98-16a5-4666-9929-adf46265c091 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:02.243904 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:02.294648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71751d98-16a5-4666-9929-adf46265c091 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:02.325622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8fb6c-8e47-46ce-a851-3652c30676b7 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:02.327940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191be885-dbea-46b2-b06f-bb87e76d0523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:02.328556 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191be885-dbea-46b2-b06f-bb87e76d0523 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:02.328828 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191be885-dbea-46b2-b06f-bb87e76d0523 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:02.329094 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191be885-dbea-46b2-b06f-bb87e76d0523 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:02.329671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191be885-dbea-46b2-b06f-bb87e76d0523 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:02.331214 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191be885-dbea-46b2-b06f-bb87e76d0523 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:02.339754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-191be885-dbea-46b2-b06f-bb87e76d0523 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 00:15:02.339754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:02.339754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:15:02.339754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:15:02.339754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:15:02.339754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:15:02.339754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:15:02.339754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:15:02.339754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 00:15:02.339754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:15:02.339754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:15:02.339754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:15:02.339754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:02.339754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:02.339754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:02.339754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:02.339754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:02.340793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:02.340793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:02.340793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:02.340793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:02.340793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:02.340793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:02.340793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:15:02.340793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:15:02.340793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:15:02.340793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:15:02.340793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:02.340793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:02.340793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:02.340793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:02.340793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:02.340793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:02.341644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:02.341644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:02.341644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:02.341644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:02.341644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:02.341644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:02.341644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:02.341644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:02.341644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:02.341644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:02.341644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:15:02.341644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:15:02.341644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 00:15:02.341644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:15:02.341644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 385/769] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:15:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:02.346660 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191be885-dbea-46b2-b06f-bb87e76d0523 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:02.425888 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8fb6c-8e47-46ce-a851-3652c30676b7 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:02.445986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191be885-dbea-46b2-b06f-bb87e76d0523 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:02.460004 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4f092-154e-4024-b6db-70285ef44de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:02.460621 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4f092-154e-4024-b6db-70285ef44de1 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:02.460894 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4f092-154e-4024-b6db-70285ef44de1 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:02.461163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4f092-154e-4024-b6db-70285ef44de1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:02.461734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4f092-154e-4024-b6db-70285ef44de1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:02.462841 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:02.463141 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4f092-154e-4024-b6db-70285ef44de1 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:02.471865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-23f4f092-154e-4024-b6db-70285ef44de1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 00:15:02.471865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:02.471865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:15:02.471865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:15:02.471865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:15:02.471865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:15:02.471865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:15:02.471865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:15:02.471865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 00:15:02.471865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:02.471865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:15:02.471865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:02.471865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:02.471865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:02.471865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:02.471865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:02.473001 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:02.473001 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:02.473001 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:02.473001 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:02.473001 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:02.473001 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:02.473001 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:02.473001 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:15:02.473001 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:15:02.473001 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:15:02.473001 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:15:02.473001 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:02.473001 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:02.473001 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:02.473001 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:02.473001 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:02.473001 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:02.474282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:02.474282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:02.474282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:02.474282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:02.474282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:02.474282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:02.474282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:02.474282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:02.474282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:02.474282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:02.474282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:15:02.474282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:15:02.474282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 00:15:02.474282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:02.474282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 385/770] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Aug 24 00:15:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:15:02.478777 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4f092-154e-4024-b6db-70285ef44de1 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:02.479901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93b52c-36e4-4283-85a7-22a02946a8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:02.481026 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93b52c-36e4-4283-85a7-22a02946a8e5 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:02.481301 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93b52c-36e4-4283-85a7-22a02946a8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:02.481568 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93b52c-36e4-4283-85a7-22a02946a8e5 None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:02.482191 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93b52c-36e4-4283-85a7-22a02946a8e5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:02.482486 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93b52c-36e4-4283-85a7-22a02946a8e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:02.483872 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93b52c-36e4-4283-85a7-22a02946a8e5 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:02.489251 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 386/771] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:15:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:02.494520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93b52c-36e4-4283-85a7-22a02946a8e5 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:02.511108 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:02.581313 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4f092-154e-4024-b6db-70285ef44de1 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:02.597759 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93b52c-36e4-4283-85a7-22a02946a8e5 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:02.613792 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8746cff-f640-409b-a66e-ec440ec3bbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:02.614385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8746cff-f640-409b-a66e-ec440ec3bbbe None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:02.614657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8746cff-f640-409b-a66e-ec440ec3bbbe None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:02.614924 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8746cff-f640-409b-a66e-ec440ec3bbbe None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:02.615569 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8746cff-f640-409b-a66e-ec440ec3bbbe None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:02.615864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8746cff-f640-409b-a66e-ec440ec3bbbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:02.617237 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8746cff-f640-409b-a66e-ec440ec3bbbe None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:02.622697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 386/772] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 24 00:15:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:02.628990 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8746cff-f640-409b-a66e-ec440ec3bbbe None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:02.632228 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a39f8-155d-4fa7-8b46-b895e2f5fa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:02.632823 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a39f8-155d-4fa7-8b46-b895e2f5fa8f None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:02.633102 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a39f8-155d-4fa7-8b46-b895e2f5fa8f None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:02.633371 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a39f8-155d-4fa7-8b46-b895e2f5fa8f None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:02.633991 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a39f8-155d-4fa7-8b46-b895e2f5fa8f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:02.634292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a39f8-155d-4fa7-8b46-b895e2f5fa8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:02.635684 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a39f8-155d-4fa7-8b46-b895e2f5fa8f None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:02.640457 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 387/773] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:15:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:02.646543 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a39f8-155d-4fa7-8b46-b895e2f5fa8f None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:02.696195 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:02.733665 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:02.740075 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8746cff-f640-409b-a66e-ec440ec3bbbe None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:02.749513 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a39f8-155d-4fa7-8b46-b895e2f5fa8f None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:02.773146 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec5fca-874d-4520-958e-4b598e2fc295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:02.773747 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec5fca-874d-4520-958e-4b598e2fc295 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:02.774028 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec5fca-874d-4520-958e-4b598e2fc295 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:02.774301 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec5fca-874d-4520-958e-4b598e2fc295 None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:02.774927 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec5fca-874d-4520-958e-4b598e2fc295 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:02.775266 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec5fca-874d-4520-958e-4b598e2fc295 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:02.776678 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec5fca-874d-4520-958e-4b598e2fc295 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:02.781954 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 387/774] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 24 00:15:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:02.783678 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ae731-26b4-42c8-945b-4485487109a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:02.784256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ae731-26b4-42c8-945b-4485487109a4 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:02.784536 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ae731-26b4-42c8-945b-4485487109a4 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:02.784808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ae731-26b4-42c8-945b-4485487109a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:02.785505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ae731-26b4-42c8-945b-4485487109a4 None admin] RBAC: Adding query filter params (interface=public, service_id=12bc3dd954834ed9a4620460fd8648de, region_id=RegionOne) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:02.785819 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ae731-26b4-42c8-945b-4485487109a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:02.787224 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ae731-26b4-42c8-945b-4485487109a4 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:02.787999 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec5fca-874d-4520-958e-4b598e2fc295 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:02.796970 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 388/775] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 24 00:15:02 2022] GET /identity/v3/endpoints?service_id=12bc3dd954834ed9a4620460fd8648de&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:02.798398 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ae731-26b4-42c8-945b-4485487109a4 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:02.896211 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec5fca-874d-4520-958e-4b598e2fc295 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:02.898761 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ae731-26b4-42c8-945b-4485487109a4 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:02.910212 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:02.931076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b321af-f717-4612-8517-4c58f3c2c769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:02.931676 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b321af-f717-4612-8517-4c58f3c2c769 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:02.931958 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b321af-f717-4612-8517-4c58f3c2c769 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:02.932226 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b321af-f717-4612-8517-4c58f3c2c769 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:02.932921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b321af-f717-4612-8517-4c58f3c2c769 None admin] RBAC: Adding query filter params (interface=public, service_id=0a83de8a82904c50a089e0ac992d706f, region_id=RegionOne) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:02.933230 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b321af-f717-4612-8517-4c58f3c2c769 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:02.934283 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38c85a-0891-42be-8db4-c8635d662b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:02.934600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b321af-f717-4612-8517-4c58f3c2c769 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:02.934881 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38c85a-0891-42be-8db4-c8635d662b75 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:02.935197 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38c85a-0891-42be-8db4-c8635d662b75 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:02.935474 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38c85a-0891-42be-8db4-c8635d662b75 None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:02.936083 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38c85a-0891-42be-8db4-c8635d662b75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:02.937756 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38c85a-0891-42be-8db4-c8635d662b75 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:02.940024 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 388/776] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 24 00:15:02 2022] GET /identity/v3/endpoints?service_id=0a83de8a82904c50a089e0ac992d706f&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:02.943732 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 389/777] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 24 00:15:02 2022] GET /identity/v3/services => generated 1498 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 00:15:02.945459 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b321af-f717-4612-8517-4c58f3c2c769 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:02.973483 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:03.053704 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b321af-f717-4612-8517-4c58f3c2c769 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:03.090668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5406ca7-7dbd-4b04-bf97-13bdce00c05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:03.091308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5406ca7-7dbd-4b04-bf97-13bdce00c05d None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:03.091657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5406ca7-7dbd-4b04-bf97-13bdce00c05d None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:03.091935 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5406ca7-7dbd-4b04-bf97-13bdce00c05d None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:03.092552 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5406ca7-7dbd-4b04-bf97-13bdce00c05d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:03.093962 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5406ca7-7dbd-4b04-bf97-13bdce00c05d None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:03.100485 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 389/778] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 24 00:15:02 2022] GET /identity/v3/services => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 00:15:05.171954 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8289c9-27b7-4c0b-91e5-c1c842ac5860 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:05.172535 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8289c9-27b7-4c0b-91e5-c1c842ac5860 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:05.172535 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8289c9-27b7-4c0b-91e5-c1c842ac5860 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:05.173819 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 390/779] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:05.179337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8129e40-b727-4f1a-b5d1-4ba141343419 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:05.179770 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8129e40-b727-4f1a-b5d1-4ba141343419 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:05.180023 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8129e40-b727-4f1a-b5d1-4ba141343419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:05.198117 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-d8129e40-b727-4f1a-b5d1-4ba141343419 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:05.199330 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-d8129e40-b727-4f1a-b5d1-4ba141343419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:05.264961 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 390/780] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:05 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:15:05.280687 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde913aa-cae7-4cbf-976c-3cc49e9953dc None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:05.280971 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde913aa-cae7-4cbf-976c-3cc49e9953dc None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:05.281240 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde913aa-cae7-4cbf-976c-3cc49e9953dc None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:05.282557 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 391/781] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:05.287773 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ca7e1-a3c8-416a-aa84-dcf603dda99f None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:05.288061 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ca7e1-a3c8-416a-aa84-dcf603dda99f None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:05.288337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ca7e1-a3c8-416a-aa84-dcf603dda99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:05.306883 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-c55ca7e1-a3c8-416a-aa84-dcf603dda99f None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:05.308094 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-c55ca7e1-a3c8-416a-aa84-dcf603dda99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:05.321059 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:05.372853 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 391/782] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:05 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:15:05.598776 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde913aa-cae7-4cbf-976c-3cc49e9953dc None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:05.699692 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde913aa-cae7-4cbf-976c-3cc49e9953dc None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:05.703474 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ca7e1-a3c8-416a-aa84-dcf603dda99f None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:05.734100 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6e2dd-0cb7-4100-aa9e-771c6eade31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:05.734721 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6e2dd-0cb7-4100-aa9e-771c6eade31f None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:05.735019 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6e2dd-0cb7-4100-aa9e-771c6eade31f None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:05.735291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6e2dd-0cb7-4100-aa9e-771c6eade31f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:05.735865 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6e2dd-0cb7-4100-aa9e-771c6eade31f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:05.737237 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6e2dd-0cb7-4100-aa9e-771c6eade31f None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:05.746384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-48b6e2dd-0cb7-4100-aa9e-771c6eade31f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 00:15:05.746384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:05.746384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:15:05.746384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:15:05.746384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:15:05.746384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:15:05.746384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:15:05.746384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:15:05.746384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 00:15:05.746384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:15:05.746384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:15:05.746384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:15:05.746384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:05.746384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:05.746384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:05.746384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:05.746384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:05.747605 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:05.747605 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:05.747605 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:05.747605 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:05.747605 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:05.747605 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:05.747605 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:15:05.747605 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:15:05.747605 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:15:05.747605 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:15:05.747605 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:05.747605 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:05.747605 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:05.747605 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:05.747605 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:05.747605 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:05.748540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:05.748540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:05.748540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:05.748540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:05.748540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:05.748540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:05.748540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:05.748540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:05.748540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:05.748540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:05.748540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:15:05.748540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:15:05.748540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 00:15:05.748540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:15:05.748540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 392/783] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:15:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:05.753349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6e2dd-0cb7-4100-aa9e-771c6eade31f None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:05.792482 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:05.804088 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ca7e1-a3c8-416a-aa84-dcf603dda99f None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:05.838417 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe2f21-ac1e-4784-89e2-3774af266f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:05.839062 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe2f21-ac1e-4784-89e2-3774af266f95 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:05.839344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe2f21-ac1e-4784-89e2-3774af266f95 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:05.839638 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe2f21-ac1e-4784-89e2-3774af266f95 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:05.840215 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe2f21-ac1e-4784-89e2-3774af266f95 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:05.841589 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe2f21-ac1e-4784-89e2-3774af266f95 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:05.853199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-befe2f21-ac1e-4784-89e2-3774af266f95 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 00:15:05.853199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:05.853199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:15:05.853199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:15:05.853199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:15:05.853199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:15:05.853199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:15:05.853199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:15:05.853199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 00:15:05.853199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:05.853199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:15:05.853199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:05.853199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:05.853199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:05.853199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:05.853199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:05.854346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:05.854346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:05.854346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:05.854346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:05.854346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:05.854346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:05.854346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:05.854346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:15:05.854346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:15:05.854346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:15:05.854346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:15:05.854346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:05.854346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:05.854346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:05.854346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:05.854346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:05.854346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:05.855368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:05.855368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:05.855368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:05.855368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:05.855368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:05.855368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:05.855368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:05.855368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:05.855368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:05.855368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:05.855368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:15:05.855368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:15:05.855368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 00:15:05.855368 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:05.856509 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6e2dd-0cb7-4100-aa9e-771c6eade31f None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:05.856601 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 392/784] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Aug 24 00:15:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:15:05.861199 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe2f21-ac1e-4784-89e2-3774af266f95 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:05.878920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:05.891988 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfd32c-20f3-42d2-a3db-1e1ab825d3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:05.892596 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfd32c-20f3-42d2-a3db-1e1ab825d3ea None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:05.892911 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfd32c-20f3-42d2-a3db-1e1ab825d3ea None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:05.893191 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfd32c-20f3-42d2-a3db-1e1ab825d3ea None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:05.893816 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfd32c-20f3-42d2-a3db-1e1ab825d3ea None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:05.894118 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfd32c-20f3-42d2-a3db-1e1ab825d3ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:05.895576 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfd32c-20f3-42d2-a3db-1e1ab825d3ea None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:05.900185 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 393/785] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:15:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:05.905791 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfd32c-20f3-42d2-a3db-1e1ab825d3ea None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:05.968456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe2f21-ac1e-4784-89e2-3774af266f95 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:06.002094 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0145fbf-da82-46da-827c-cf8ef70423e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:06.002689 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0145fbf-da82-46da-827c-cf8ef70423e3 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:06.002971 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0145fbf-da82-46da-827c-cf8ef70423e3 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:06.003279 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0145fbf-da82-46da-827c-cf8ef70423e3 None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:06.003906 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0145fbf-da82-46da-827c-cf8ef70423e3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:06.004210 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0145fbf-da82-46da-827c-cf8ef70423e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:06.005600 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0145fbf-da82-46da-827c-cf8ef70423e3 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:06.010253 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 393/786] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 24 00:15:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:06.012552 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfd32c-20f3-42d2-a3db-1e1ab825d3ea None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:06.014096 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:06.016685 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0145fbf-da82-46da-827c-cf8ef70423e3 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:06.047647 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88e39d-b64a-41c1-b40d-15ebdd388630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:06.048174 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88e39d-b64a-41c1-b40d-15ebdd388630 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:06.048458 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88e39d-b64a-41c1-b40d-15ebdd388630 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:06.048733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88e39d-b64a-41c1-b40d-15ebdd388630 None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:06.049364 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88e39d-b64a-41c1-b40d-15ebdd388630 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:06.049667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88e39d-b64a-41c1-b40d-15ebdd388630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:06.051077 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88e39d-b64a-41c1-b40d-15ebdd388630 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:06.055927 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 394/787] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 00:15:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:06.062373 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88e39d-b64a-41c1-b40d-15ebdd388630 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:06.093623 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:06.116735 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0145fbf-da82-46da-827c-cf8ef70423e3 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:06.151559 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba69c91-f9ef-4505-b4a1-cb363cb5cfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:06.152158 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba69c91-f9ef-4505-b4a1-cb363cb5cfce None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:06.152441 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba69c91-f9ef-4505-b4a1-cb363cb5cfce None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:06.152714 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba69c91-f9ef-4505-b4a1-cb363cb5cfce None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:06.153335 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba69c91-f9ef-4505-b4a1-cb363cb5cfce None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:06.153640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba69c91-f9ef-4505-b4a1-cb363cb5cfce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:06.155033 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba69c91-f9ef-4505-b4a1-cb363cb5cfce None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:06.159715 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 394/788] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 24 00:15:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:06.164905 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88e39d-b64a-41c1-b40d-15ebdd388630 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:06.165443 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba69c91-f9ef-4505-b4a1-cb363cb5cfce None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:06.199758 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac85476-26a3-4d7d-97ea-94d1a702ff9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:06.200355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac85476-26a3-4d7d-97ea-94d1a702ff9a None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:06.200634 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac85476-26a3-4d7d-97ea-94d1a702ff9a None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:06.200901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac85476-26a3-4d7d-97ea-94d1a702ff9a None admin] PATH_INFO: `/v3/endpoints` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:06.201548 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac85476-26a3-4d7d-97ea-94d1a702ff9a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:06.202915 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac85476-26a3-4d7d-97ea-94d1a702ff9a None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:06.223102 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 395/789] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 00:15:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:15:06.270511 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba69c91-f9ef-4505-b4a1-cb363cb5cfce None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:06.315748 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e713e59-e0b8-4c41-94b2-1d3a7d06afdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:06.316277 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e713e59-e0b8-4c41-94b2-1d3a7d06afdd None admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:06.316557 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e713e59-e0b8-4c41-94b2-1d3a7d06afdd None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:06.316831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e713e59-e0b8-4c41-94b2-1d3a7d06afdd None admin] PATH_INFO: `/v3/endpoints` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:06.317502 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e713e59-e0b8-4c41-94b2-1d3a7d06afdd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:06.318932 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e713e59-e0b8-4c41-94b2-1d3a7d06afdd None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:06.324869 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:06.341200 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 395/790] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 00:15:06 2022] POST /identity/v3/endpoints => generated 347 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:15:08.436639 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f341c7-c40d-4d1a-a617-b78bc0f2356f None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:08.437435 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f341c7-c40d-4d1a-a617-b78bc0f2356f None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:08.437435 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f341c7-c40d-4d1a-a617-b78bc0f2356f None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:08.438771 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 396/791] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:08.444072 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01404b98-b03d-4856-ac4f-c92e9cb605ca None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:08.444501 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01404b98-b03d-4856-ac4f-c92e9cb605ca None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:08.444603 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01404b98-b03d-4856-ac4f-c92e9cb605ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:08.462928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-01404b98-b03d-4856-ac4f-c92e9cb605ca None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:08.464130 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-01404b98-b03d-4856-ac4f-c92e9cb605ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:08.532428 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5c798-e6bf-4417-aa09-41486229fe4a None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:08.532715 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5c798-e6bf-4417-aa09-41486229fe4a None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:08.532995 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5c798-e6bf-4417-aa09-41486229fe4a None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:08.534459 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 397/792] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:08.539265 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feddd7-909e-4264-955b-6cfd0c237b0f None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:08.539552 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feddd7-909e-4264-955b-6cfd0c237b0f None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:08.539827 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feddd7-909e-4264-955b-6cfd0c237b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:08.541213 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 396/793] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:08 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:15:08.557124 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-19feddd7-909e-4264-955b-6cfd0c237b0f None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:08.558327 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-19feddd7-909e-4264-955b-6cfd0c237b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:08.575525 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:08.627967 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 398/794] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:08 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 00:15:08.879635 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01404b98-b03d-4856-ac4f-c92e9cb605ca None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:08.954499 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19feddd7-909e-4264-955b-6cfd0c237b0f None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:08.981258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01404b98-b03d-4856-ac4f-c92e9cb605ca None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:08.999655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:09.018531 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec61a5-31be-49b2-9c2e-4766b113a47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:09.019164 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec61a5-31be-49b2-9c2e-4766b113a47b None admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:09.019444 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec61a5-31be-49b2-9c2e-4766b113a47b None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:09.019721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec61a5-31be-49b2-9c2e-4766b113a47b None admin] PATH_INFO: `/v3/projects` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:09.020360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec61a5-31be-49b2-9c2e-4766b113a47b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:09.021798 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec61a5-31be-49b2-9c2e-4766b113a47b None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:09.024397 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: WARNING keystone.server.flask.common [None req-2bec61a5-31be-49b2-9c2e-4766b113a47b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 00:15:09.045048 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.sql.core [None req-2bec61a5-31be-49b2-9c2e-4766b113a47b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 00:15:09.045048 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 00:15:09.045048 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [parameters: {'id': '8284ae059ca74b29ba77588df3a20e5b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 00:15:09.045048 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=94660) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 00:15:09.062378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-2bec61a5-31be-49b2-9c2e-4766b113a47b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8284ae059ca74b29ba77588df3a20e5b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8284ae059ca74b29ba77588df3a20e5b. Aug 24 00:15:09.062378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:09.062378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 00:15:09.062378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 00:15:09.062378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 00:15:09.062378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 00:15:09.062378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 00:15:09.062378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 00:15:09.062378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 00:15:09.062378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application conn.query(q) Aug 24 00:15:09.062378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 00:15:09.062378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 00:15:09.062378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 00:15:09.063471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application result.read() Aug 24 00:15:09.063471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 00:15:09.063471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 00:15:09.063471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 00:15:09.063471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 00:15:09.063471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 00:15:09.063471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 00:15:09.063471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 00:15:09.063471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 00:15:09.063471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 00:15:09.063471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:09.063471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 00:15:09.063471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:09.063471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:09.063471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 00:15:09.063471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 00:15:09.063471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 00:15:09.063471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 00:15:09.064759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 00:15:09.064759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application next(self.gen) Aug 24 00:15:09.064759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 00:15:09.064759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application yield resource Aug 24 00:15:09.064759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 00:15:09.064759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application next(self.gen) Aug 24 00:15:09.064759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 00:15:09.064759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 00:15:09.064759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 00:15:09.064759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 00:15:09.064759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 00:15:09.064759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise self.value Aug 24 00:15:09.064759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 00:15:09.064759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 00:15:09.064759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 00:15:09.064759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application session.commit() Aug 24 00:15:09.064759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 00:15:09.065928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 00:15:09.065928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 00:15:09.065928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 00:15:09.065928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 00:15:09.065928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self.session.flush() Aug 24 00:15:09.065928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 00:15:09.065928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 00:15:09.065928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 00:15:09.065928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 00:15:09.065928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 00:15:09.065928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application compat.raise_( Aug 24 00:15:09.065928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 00:15:09.065928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception Aug 24 00:15:09.065928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 00:15:09.065928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 00:15:09.065928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 00:15:09.065928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 00:15:09.067289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 00:15:09.067289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 00:15:09.067289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 00:15:09.067289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 00:15:09.067289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 00:15:09.067289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 00:15:09.067289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 00:15:09.067289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 00:15:09.067289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 00:15:09.067289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 00:15:09.067289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 00:15:09.067289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 00:15:09.067289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 00:15:09.067289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 00:15:09.067289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 00:15:09.068450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 00:15:09.068450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 00:15:09.068450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception Aug 24 00:15:09.068450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 00:15:09.068450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 00:15:09.068450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 00:15:09.068450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 00:15:09.068450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 00:15:09.068450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 00:15:09.068450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 00:15:09.068450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application conn.query(q) Aug 24 00:15:09.068450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 00:15:09.068450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 00:15:09.068450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 00:15:09.068450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application result.read() Aug 24 00:15:09.068450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 00:15:09.068450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 00:15:09.069479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 00:15:09.069479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 00:15:09.069479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 00:15:09.069479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 00:15:09.069479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 00:15:09.069479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 00:15:09.069479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 00:15:09.069479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 00:15:09.069479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [parameters: {'id': '8284ae059ca74b29ba77588df3a20e5b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 00:15:09.069479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 00:15:09.069479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:09.069479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:15:09.069479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:09.069479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:09.069479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 00:15:09.070728 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 00:15:09.070728 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 00:15:09.070728 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 00:15:09.070728 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 00:15:09.070728 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:09.070728 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:15:09.070728 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:09.070728 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:09.070728 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:09.070728 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:09.070728 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:09.070728 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:09.070728 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:09.070728 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:09.070728 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:09.070728 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:09.070728 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:09.072401 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:09.072401 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 00:15:09.072401 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 00:15:09.072401 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:09.072401 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:09.072401 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 00:15:09.072401 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 00:15:09.072401 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8284ae059ca74b29ba77588df3a20e5b. Aug 24 00:15:09.072401 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:09.072401 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 397/795] 10.222.0.42 () {60 vars in 1140 bytes} [Wed Aug 24 00:15:08 2022] POST /identity/v3/projects => generated 262 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:09.072401 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec61a5-31be-49b2-9c2e-4766b113a47b None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:09.075024 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19feddd7-909e-4264-955b-6cfd0c237b0f None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:09.109960 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be04ed-a6a0-401a-97b4-9daee5936bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:09.110587 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be04ed-a6a0-401a-97b4-9daee5936bac None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:09.110862 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be04ed-a6a0-401a-97b4-9daee5936bac None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:09.111158 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be04ed-a6a0-401a-97b4-9daee5936bac None admin] PATH_INFO: `/v3/services/compute` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:09.111749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be04ed-a6a0-401a-97b4-9daee5936bac None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:09.113121 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be04ed-a6a0-401a-97b4-9daee5936bac None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:09.122315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-95be04ed-a6a0-401a-97b4-9daee5936bac None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 00:15:09.122315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:09.122315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:15:09.122315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:15:09.122315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:15:09.122315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:15:09.122315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:15:09.122315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:15:09.122315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 00:15:09.122315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:15:09.122315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:15:09.122315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:15:09.122315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:09.122315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:09.122315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:09.122315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:09.122315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:09.123570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:09.123570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:09.123570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:09.123570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:09.123570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:09.123570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:09.123570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:15:09.123570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:15:09.123570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:15:09.123570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:15:09.123570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:09.123570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:09.123570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:09.123570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:09.123570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:09.123570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:09.124563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:09.124563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:09.124563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:09.124563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:09.124563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:09.124563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:09.124563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:09.124563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:09.124563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:09.124563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:09.124563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:15:09.124563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:15:09.124563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 00:15:09.124563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:15:09.124563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 399/796] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:15:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:15:09.129236 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be04ed-a6a0-401a-97b4-9daee5936bac None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:09.146875 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:09.171341 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec61a5-31be-49b2-9c2e-4766b113a47b None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:09.204599 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3af996-b5d3-4372-a8b4-accdc33823ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:09.205356 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3af996-b5d3-4372-a8b4-accdc33823ef None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:09.205636 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3af996-b5d3-4372-a8b4-accdc33823ef None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:09.205904 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3af996-b5d3-4372-a8b4-accdc33823ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:09.212489 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3af996-b5d3-4372-a8b4-accdc33823ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:09.214122 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3af996-b5d3-4372-a8b4-accdc33823ef None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:09.225131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-2b3af996-b5d3-4372-a8b4-accdc33823ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:15:09.225131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:09.225131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:09.225131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:09.225131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:09.225131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:09.225131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:09.225131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:09.225131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:09.225131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:09.225131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:09.225131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:09.225131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:15:09.225131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:15:09.225131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:15:09.226240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:15:09.226240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:09.226240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:09.226240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:09.226240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:09.226240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:09.226240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:09.226240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:09.226240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:09.226240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:09.226240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:09.226240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:09.226240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:09.226240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:09.226240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:09.226240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:09.226240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:09.227378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:15:09.227378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:15:09.227378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:15:09.227378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:15:09.227378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:15:09.227378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:15:09.227378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:15:09.227378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:09.227378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 398/797] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:15:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:15:09.232326 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be04ed-a6a0-401a-97b4-9daee5936bac None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:09.232446 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3af996-b5d3-4372-a8b4-accdc33823ef None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:09.266073 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:09.266284 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab62093-e15f-4590-8457-ff3d9d21500f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:09.266878 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab62093-e15f-4590-8457-ff3d9d21500f None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:09.267956 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab62093-e15f-4590-8457-ff3d9d21500f None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:09.268325 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab62093-e15f-4590-8457-ff3d9d21500f None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:09.268959 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab62093-e15f-4590-8457-ff3d9d21500f None admin] RBAC: Adding query filter params (name=compute) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:09.269258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab62093-e15f-4590-8457-ff3d9d21500f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:09.270655 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab62093-e15f-4590-8457-ff3d9d21500f None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:09.276169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 400/798] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 00:15:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:09.281712 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab62093-e15f-4590-8457-ff3d9d21500f None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:09.339077 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3af996-b5d3-4372-a8b4-accdc33823ef None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:09.359789 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:09.373563 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3f5f5-0bbf-42c8-85b8-a7becd828bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:09.374164 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3f5f5-0bbf-42c8-85b8-a7becd828bcb None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:09.374438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3f5f5-0bbf-42c8-85b8-a7becd828bcb None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:09.374720 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3f5f5-0bbf-42c8-85b8-a7becd828bcb None admin] PATH_INFO: `/v3/projects` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:09.375406 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3f5f5-0bbf-42c8-85b8-a7becd828bcb None admin] RBAC: Adding query filter params (name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:09.375714 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3f5f5-0bbf-42c8-85b8-a7becd828bcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:09.377154 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3f5f5-0bbf-42c8-85b8-a7becd828bcb None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:09.380569 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab62093-e15f-4590-8457-ff3d9d21500f None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:09.397023 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 399/799] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 00:15:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:09.414535 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ccd25c-3d03-4d20-9cdb-88a8870fb178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:09.415219 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccd25c-3d03-4d20-9cdb-88a8870fb178 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:09.415501 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccd25c-3d03-4d20-9cdb-88a8870fb178 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:09.415774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccd25c-3d03-4d20-9cdb-88a8870fb178 None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:09.416422 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ccd25c-3d03-4d20-9cdb-88a8870fb178 None admin] RBAC: Adding query filter params (type=compute) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:09.416728 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ccd25c-3d03-4d20-9cdb-88a8870fb178 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:09.418675 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ccd25c-3d03-4d20-9cdb-88a8870fb178 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:09.424232 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 401/800] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 00:15:09 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:15:11.617255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed407e83-9915-412e-93ae-ce37cebd389b None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:11.617806 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed407e83-9915-412e-93ae-ce37cebd389b None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:11.617806 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed407e83-9915-412e-93ae-ce37cebd389b None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:11.619146 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 400/801] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:11.625189 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96a5a2-7db0-4155-a4dc-d3dbd1eb676f None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:11.625617 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96a5a2-7db0-4155-a4dc-d3dbd1eb676f None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:11.625870 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96a5a2-7db0-4155-a4dc-d3dbd1eb676f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:11.643878 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-0a96a5a2-7db0-4155-a4dc-d3dbd1eb676f None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:11.645075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-0a96a5a2-7db0-4155-a4dc-d3dbd1eb676f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:11.654183 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6460d41-94f5-4b79-bdaf-2b9f4c56220c None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:11.654468 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6460d41-94f5-4b79-bdaf-2b9f4c56220c None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:11.654749 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6460d41-94f5-4b79-bdaf-2b9f4c56220c None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:11.656382 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 401/802] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:15:11.661074 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5b890-f7da-4858-84fd-2de5b5cf320d None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:11.661353 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5b890-f7da-4858-84fd-2de5b5cf320d None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:11.661629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5b890-f7da-4858-84fd-2de5b5cf320d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:11.681082 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-6cb5b890-f7da-4858-84fd-2de5b5cf320d None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:11.682589 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-6cb5b890-f7da-4858-84fd-2de5b5cf320d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:11.717867 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 402/803] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:11 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:15:11.750607 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 402/804] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:11 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 00:15:12.045352 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96a5a2-7db0-4155-a4dc-d3dbd1eb676f None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:12.079750 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5b890-f7da-4858-84fd-2de5b5cf320d None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:12.103615 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:12.121549 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:12.146497 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96a5a2-7db0-4155-a4dc-d3dbd1eb676f None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:12.179976 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5b890-f7da-4858-84fd-2de5b5cf320d None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:12.180915 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013eed9-538d-4ca6-8005-f12c73931ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:12.181517 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013eed9-538d-4ca6-8005-f12c73931ac9 None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:12.181795 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013eed9-538d-4ca6-8005-f12c73931ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:12.182075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013eed9-538d-4ca6-8005-f12c73931ac9 None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:12.182726 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013eed9-538d-4ca6-8005-f12c73931ac9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:12.184683 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013eed9-538d-4ca6-8005-f12c73931ac9 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:12.200242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 403/805] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 00:15:12 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:15:12.228645 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c306ba-7741-4dc9-9a97-2f4a904eddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:12.229263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c306ba-7741-4dc9-9a97-2f4a904eddcb None admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:12.229543 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c306ba-7741-4dc9-9a97-2f4a904eddcb None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:12.230340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c306ba-7741-4dc9-9a97-2f4a904eddcb None admin] PATH_INFO: `/v3/users` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:12.231063 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c306ba-7741-4dc9-9a97-2f4a904eddcb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:12.232552 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c306ba-7741-4dc9-9a97-2f4a904eddcb None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:12.248034 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.sql.core [None req-f9c306ba-7741-4dc9-9a97-2f4a904eddcb None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 00:15:12.248034 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 00:15:12.248034 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [parameters: {'user_id': '1a9718756b1943caa7d4b1b58bb026e9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 00:15:12.248034 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=94660) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 00:15:12.254516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-f9c306ba-7741-4dc9-9a97-2f4a904eddcb None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 00:15:12.254516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:12.254516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 00:15:12.254516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 00:15:12.254516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 00:15:12.254516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 00:15:12.254516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 00:15:12.254516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 00:15:12.254516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 00:15:12.254516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application conn.query(q) Aug 24 00:15:12.254516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 00:15:12.254516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 00:15:12.254516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 00:15:12.254516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application result.read() Aug 24 00:15:12.254516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 00:15:12.255697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 00:15:12.255697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 00:15:12.255697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 00:15:12.255697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 00:15:12.255697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 00:15:12.255697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 00:15:12.255697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 00:15:12.255697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 00:15:12.255697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:12.255697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 00:15:12.255697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:12.255697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:12.255697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 00:15:12.255697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 00:15:12.255697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 00:15:12.255697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 00:15:12.255697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 00:15:12.255697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application next(self.gen) Aug 24 00:15:12.256677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 00:15:12.256677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application yield resource Aug 24 00:15:12.256677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 00:15:12.256677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application next(self.gen) Aug 24 00:15:12.256677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 00:15:12.256677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 00:15:12.256677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 00:15:12.256677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 00:15:12.256677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 00:15:12.256677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise self.value Aug 24 00:15:12.256677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 00:15:12.256677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 00:15:12.256677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 00:15:12.256677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application session.commit() Aug 24 00:15:12.256677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 00:15:12.256677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 00:15:12.256677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 00:15:12.257861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 00:15:12.257861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 00:15:12.257861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self.session.flush() Aug 24 00:15:12.257861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 00:15:12.257861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 00:15:12.257861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 00:15:12.257861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 00:15:12.257861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 00:15:12.257861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application compat.raise_( Aug 24 00:15:12.257861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 00:15:12.257861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception Aug 24 00:15:12.257861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 00:15:12.257861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 00:15:12.257861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 00:15:12.257861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 00:15:12.257861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 00:15:12.257861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 00:15:12.258738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 00:15:12.258738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 00:15:12.258738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 00:15:12.258738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 00:15:12.258738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 00:15:12.258738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 00:15:12.258738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 00:15:12.258738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 00:15:12.258738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 00:15:12.258738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 00:15:12.258738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 00:15:12.258738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 00:15:12.258738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 00:15:12.258738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 00:15:12.258738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 00:15:12.258738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception Aug 24 00:15:12.259594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 00:15:12.259594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 00:15:12.259594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 00:15:12.259594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 00:15:12.259594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 00:15:12.259594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 00:15:12.259594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 00:15:12.259594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application conn.query(q) Aug 24 00:15:12.259594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 00:15:12.259594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 00:15:12.259594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 00:15:12.259594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application result.read() Aug 24 00:15:12.259594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 00:15:12.259594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 00:15:12.259594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 00:15:12.259594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 00:15:12.260438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 00:15:12.260438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 00:15:12.260438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 00:15:12.260438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 00:15:12.260438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 00:15:12.260438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 00:15:12.260438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [parameters: {'user_id': '1a9718756b1943caa7d4b1b58bb026e9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 00:15:12.260438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 00:15:12.260438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:12.260438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:15:12.260438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:12.260438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:12.260438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:12.260438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:12.260438 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:12.261221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:12.261221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:12.261221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:12.261221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:12.261221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:12.261221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:12.261221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:12.261221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 00:15:12.261221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 00:15:12.261221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:12.261221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:12.261221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:15:12.261221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:15:12.261221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:15:12.261221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:15:12.261221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 00:15:12.261221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 00:15:12.262139 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 00:15:12.262139 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 00:15:12.262139 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 00:15:12.262139 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 00:15:12.262139 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 00:15:12.262139 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:12.262139 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 403/806] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Aug 24 00:15:12 2022] POST /identity/v3/users => generated 160 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:15:12.263088 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013eed9-538d-4ca6-8005-f12c73931ac9 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:12.369056 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013eed9-538d-4ca6-8005-f12c73931ac9 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:12.404159 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e11d4-8840-4f36-9a3e-ef1dc77786dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:12.409295 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e11d4-8840-4f36-9a3e-ef1dc77786dc None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:12.409576 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e11d4-8840-4f36-9a3e-ef1dc77786dc None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:12.411240 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e11d4-8840-4f36-9a3e-ef1dc77786dc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:12.413575 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:12.420492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e11d4-8840-4f36-9a3e-ef1dc77786dc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:12.422373 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e11d4-8840-4f36-9a3e-ef1dc77786dc None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:12.434374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-be1e11d4-8840-4f36-9a3e-ef1dc77786dc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 00:15:12.434374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:12.434374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:12.434374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:12.434374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:12.434374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:12.434374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:12.434374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:12.434374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:12.434374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:12.434374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:12.434374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:12.434374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:15:12.434374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:15:12.434374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:15:12.434374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:15:12.435561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:12.435561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:12.435561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:15:12.435561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:15:12.435561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:15:12.435561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:15:12.435561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:12.435561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:12.435561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:12.435561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:12.435561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:12.435561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:12.435561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:12.435561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:12.435561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:12.435561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:12.435561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:12.435561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:12.436505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:12.436505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:12.436505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:15:12.436505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:15:12.436505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:15:12.436505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:15:12.436505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:15:12.436505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:15:12.436505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 00:15:12.436505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:15:12.436505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 404/807] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:15:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:12.442002 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c306ba-7741-4dc9-9a97-2f4a904eddcb None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:12.531855 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:12.551163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c306ba-7741-4dc9-9a97-2f4a904eddcb None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:12.584474 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f201465-3fb2-465c-8edf-7567df9e09a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:12.585071 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f201465-3fb2-465c-8edf-7567df9e09a9 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:12.585352 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f201465-3fb2-465c-8edf-7567df9e09a9 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:12.585625 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f201465-3fb2-465c-8edf-7567df9e09a9 None admin] PATH_INFO: `/v3/users` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:12.586318 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f201465-3fb2-465c-8edf-7567df9e09a9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:12.586622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f201465-3fb2-465c-8edf-7567df9e09a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:12.588299 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f201465-3fb2-465c-8edf-7567df9e09a9 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:12.626316 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 404/808] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 00:15:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:14.413204 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405db305-2e54-46da-be60-83f81fa2b0f3 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:14.413726 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405db305-2e54-46da-be60-83f81fa2b0f3 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:14.413726 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405db305-2e54-46da-be60-83f81fa2b0f3 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:14.415225 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 405/809] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:14.421131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ce9b7-0778-410c-9d1b-9e9c22a2f019 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:14.421497 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ce9b7-0778-410c-9d1b-9e9c22a2f019 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:14.421682 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ce9b7-0778-410c-9d1b-9e9c22a2f019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:14.440677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-c09ce9b7-0778-410c-9d1b-9e9c22a2f019 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:14.442597 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-c09ce9b7-0778-410c-9d1b-9e9c22a2f019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:14.507659 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 405/810] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:14 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:15:14.836740 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405db305-2e54-46da-be60-83f81fa2b0f3 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:14.936237 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405db305-2e54-46da-be60-83f81fa2b0f3 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:14.969116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b98ed6-b212-4a91-958b-bf3edb385c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:14.969733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b98ed6-b212-4a91-958b-bf3edb385c23 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:14.970015 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b98ed6-b212-4a91-958b-bf3edb385c23 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:14.970289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b98ed6-b212-4a91-958b-bf3edb385c23 None admin] PATH_INFO: `/v3/services/compute` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:14.970896 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b98ed6-b212-4a91-958b-bf3edb385c23 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:14.973336 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b98ed6-b212-4a91-958b-bf3edb385c23 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:14.982539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-a1b98ed6-b212-4a91-958b-bf3edb385c23 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 00:15:14.982539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:14.982539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:15:14.982539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:15:14.982539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:15:14.982539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:15:14.982539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:15:14.982539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:15:14.982539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 00:15:14.982539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:15:14.982539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:15:14.982539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:15:14.982539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:14.982539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:14.982539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:14.982539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:14.982539 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:14.983709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:14.983709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:14.983709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:14.983709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:14.983709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:14.983709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:14.983709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:15:14.983709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:15:14.983709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:15:14.983709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:15:14.983709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:14.983709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:14.983709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:14.983709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:14.983709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:14.983709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:14.984859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:14.984859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:14.984859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:14.984859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:14.984859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:14.984859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:14.984859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:14.984859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:14.984859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:14.984859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:14.984859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:15:14.984859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:15:14.984859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 00:15:14.984859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:15:14.984859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 406/811] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:15:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:15:14.989565 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ce9b7-0778-410c-9d1b-9e9c22a2f019 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:15.057478 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:15.087772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ce9b7-0778-410c-9d1b-9e9c22a2f019 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:15.123578 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034375b0-8b4f-4af2-b2cc-6f3e653a1995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:15.124169 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034375b0-8b4f-4af2-b2cc-6f3e653a1995 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:15.124446 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034375b0-8b4f-4af2-b2cc-6f3e653a1995 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:15.124793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034375b0-8b4f-4af2-b2cc-6f3e653a1995 None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:15.125419 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034375b0-8b4f-4af2-b2cc-6f3e653a1995 None admin] RBAC: Adding query filter params (name=compute) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:15.125718 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034375b0-8b4f-4af2-b2cc-6f3e653a1995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:15.127218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034375b0-8b4f-4af2-b2cc-6f3e653a1995 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:15.132072 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 406/812] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 00:15:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:15.138346 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b98ed6-b212-4a91-958b-bf3edb385c23 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:15.196073 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:15.236832 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b98ed6-b212-4a91-958b-bf3edb385c23 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:15.269082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eff49c-8175-49df-aa88-54fd74d1c641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:15.269916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eff49c-8175-49df-aa88-54fd74d1c641 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:15.270191 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eff49c-8175-49df-aa88-54fd74d1c641 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:15.270457 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eff49c-8175-49df-aa88-54fd74d1c641 None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:15.271103 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eff49c-8175-49df-aa88-54fd74d1c641 None admin] RBAC: Adding query filter params (type=compute) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:15.271404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eff49c-8175-49df-aa88-54fd74d1c641 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:15.272759 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eff49c-8175-49df-aa88-54fd74d1c641 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:15.278036 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 407/813] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 00:15:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:15.284118 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034375b0-8b4f-4af2-b2cc-6f3e653a1995 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:15.380743 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034375b0-8b4f-4af2-b2cc-6f3e653a1995 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:15.414122 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaa363-7db6-4538-ad67-b107e1a78d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:15.414709 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaa363-7db6-4538-ad67-b107e1a78d3e None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:15.414988 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaa363-7db6-4538-ad67-b107e1a78d3e None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:15.415294 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaa363-7db6-4538-ad67-b107e1a78d3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:15.415986 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeaa363-7db6-4538-ad67-b107e1a78d3e None admin] RBAC: Adding query filter params (interface=public, service_id=63e73461979844b69070cec06312cbe2, region_id=RegionOne) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:15.416293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeaa363-7db6-4538-ad67-b107e1a78d3e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:15.417681 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeaa363-7db6-4538-ad67-b107e1a78d3e None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:15.419226 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:15.423617 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 407/814] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 24 00:15:15 2022] GET /identity/v3/endpoints?service_id=63e73461979844b69070cec06312cbe2&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:15.429078 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eff49c-8175-49df-aa88-54fd74d1c641 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:15.526522 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eff49c-8175-49df-aa88-54fd74d1c641 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:15.549448 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:15.561657 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f98a1-eff8-42b9-be05-cbf35cff9bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:15.562267 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f98a1-eff8-42b9-be05-cbf35cff9bda None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:15.562542 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f98a1-eff8-42b9-be05-cbf35cff9bda None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:15.562812 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f98a1-eff8-42b9-be05-cbf35cff9bda None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:15.563448 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f98a1-eff8-42b9-be05-cbf35cff9bda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:15.564809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f98a1-eff8-42b9-be05-cbf35cff9bda None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:15.570767 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 408/815] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 24 00:15:15 2022] GET /identity/v3/services => generated 1728 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:15:17.729354 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe462d-643a-4ab8-983c-ebfbf04889b8 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:17.729894 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe462d-643a-4ab8-983c-ebfbf04889b8 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:17.729894 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe462d-643a-4ab8-983c-ebfbf04889b8 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:17.731278 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 408/816] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:15:17.736519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4e8df-48bb-42f8-b3c0-c269d06487c8 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:17.736921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4e8df-48bb-42f8-b3c0-c269d06487c8 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:17.737065 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4e8df-48bb-42f8-b3c0-c269d06487c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:17.755109 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-84d4e8df-48bb-42f8-b3c0-c269d06487c8 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:15:17.756291 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-84d4e8df-48bb-42f8-b3c0-c269d06487c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:15:17.819831 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 409/817] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:15:17 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:15:18.159924 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe462d-643a-4ab8-983c-ebfbf04889b8 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:18.259959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe462d-643a-4ab8-983c-ebfbf04889b8 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:18.291902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca8b18-85d6-446c-8a12-5d4f82f51d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:18.293016 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca8b18-85d6-446c-8a12-5d4f82f51d81 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:18.293292 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca8b18-85d6-446c-8a12-5d4f82f51d81 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:18.293561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca8b18-85d6-446c-8a12-5d4f82f51d81 None admin] PATH_INFO: `/v3/services/compute` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:18.294128 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca8b18-85d6-446c-8a12-5d4f82f51d81 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:18.295531 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca8b18-85d6-446c-8a12-5d4f82f51d81 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:18.304203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-dcca8b18-85d6-446c-8a12-5d4f82f51d81 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 00:15:18.304203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:18.304203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:15:18.304203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:15:18.304203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:15:18.304203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:15:18.304203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:15:18.304203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:15:18.304203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 00:15:18.304203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:18.304203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:15:18.304203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:18.304203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:15:18.304203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:15:18.304203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:15:18.304203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:15:18.304203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:15:18.305555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:15:18.305555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:15:18.305555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:15:18.305555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:15:18.305555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:15:18.305555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:15:18.305555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:15:18.305555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:15:18.305555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:15:18.305555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:15:18.305555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:15:18.305555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:15:18.305555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:15:18.305555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:15:18.305555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:15:18.305555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:15:18.306775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:15:18.306775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:15:18.306775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:15:18.306775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:15:18.306775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:15:18.306775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:15:18.306775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:15:18.306775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:15:18.306775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:15:18.306775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:15:18.306775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:15:18.306775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:15:18.306775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 00:15:18.306775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:15:18.306775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 409/818] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:15:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:15:18.312136 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4e8df-48bb-42f8-b3c0-c269d06487c8 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:18.408937 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4e8df-48bb-42f8-b3c0-c269d06487c8 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:18.425590 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:18.444471 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b798307-452c-4ef4-ba32-9613365d3670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:18.445105 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b798307-452c-4ef4-ba32-9613365d3670 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:18.445387 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b798307-452c-4ef4-ba32-9613365d3670 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:18.445662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b798307-452c-4ef4-ba32-9613365d3670 None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:18.446289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b798307-452c-4ef4-ba32-9613365d3670 None admin] RBAC: Adding query filter params (name=compute) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:18.446592 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b798307-452c-4ef4-ba32-9613365d3670 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:18.448014 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b798307-452c-4ef4-ba32-9613365d3670 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:18.452781 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 410/819] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 00:15:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:18.458538 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca8b18-85d6-446c-8a12-5d4f82f51d81 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:18.518843 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:18.558197 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca8b18-85d6-446c-8a12-5d4f82f51d81 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:18.593471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1313ec9-16d2-4055-8754-91c52d037615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:18.594063 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1313ec9-16d2-4055-8754-91c52d037615 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:18.594338 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1313ec9-16d2-4055-8754-91c52d037615 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:18.594609 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1313ec9-16d2-4055-8754-91c52d037615 None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:18.595421 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1313ec9-16d2-4055-8754-91c52d037615 None admin] RBAC: Adding query filter params (type=compute) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:15:18.595733 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1313ec9-16d2-4055-8754-91c52d037615 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:18.597125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1313ec9-16d2-4055-8754-91c52d037615 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:18.601838 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 410/820] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 00:15:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:15:18.608296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b798307-452c-4ef4-ba32-9613365d3670 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:15:18.704494 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b798307-452c-4ef4-ba32-9613365d3670 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:15:18.737216 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c763bc5-3712-40ed-bad3-e1cdbe13b7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:15:18.737803 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c763bc5-3712-40ed-bad3-e1cdbe13b7fa None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:15:18.738078 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c763bc5-3712-40ed-bad3-e1cdbe13b7fa None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:15:18.738344 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c763bc5-3712-40ed-bad3-e1cdbe13b7fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:15:18.739022 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c763bc5-3712-40ed-bad3-e1cdbe13b7fa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:15:18.740374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c763bc5-3712-40ed-bad3-e1cdbe13b7fa None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:15:18.758659 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 411/821] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 00:15:18 2022] POST /identity/v3/endpoints => generated 334 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:15:28.599476 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=37 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:15:28.754640 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=81,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:21.133390 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddbe3d-7236-44c0-9296-7471a13f6585 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:21.134003 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddbe3d-7236-44c0-9296-7471a13f6585 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:21.134003 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddbe3d-7236-44c0-9296-7471a13f6585 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:21.135576 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 411/822] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:21.142783 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c24bd4-fb56-4e0e-b1e5-a71d1f32c7d6 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:21.142783 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c24bd4-fb56-4e0e-b1e5-a71d1f32c7d6 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:21.142783 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c24bd4-fb56-4e0e-b1e5-a71d1f32c7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:21.161540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-82c24bd4-fb56-4e0e-b1e5-a71d1f32c7d6 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:21.162758 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-82c24bd4-fb56-4e0e-b1e5-a71d1f32c7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:21.246730 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 412/823] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:21 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:21.599679 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddbe3d-7236-44c0-9296-7471a13f6585 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:21.730567 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddbe3d-7236-44c0-9296-7471a13f6585 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:21.772846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe70bc7-ad0b-4d15-b00d-9353e6472fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:21.773500 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe70bc7-ad0b-4d15-b00d-9353e6472fd9 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:21.774358 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe70bc7-ad0b-4d15-b00d-9353e6472fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:21.774668 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe70bc7-ad0b-4d15-b00d-9353e6472fd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:21.790050 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe70bc7-ad0b-4d15-b00d-9353e6472fd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:21.791849 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe70bc7-ad0b-4d15-b00d-9353e6472fd9 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:21.809467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-dfe70bc7-ad0b-4d15-b00d-9353e6472fd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:21.809467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:21.809467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:21.809467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:21.809467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:21.809467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:21.809467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:21.809467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:21.809467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:21.809467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:21.809467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:21.809467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:21.809467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:21.809467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:21.809467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:21.809467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:21.810593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:21.810593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:21.810593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:21.810593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:21.810593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:21.810593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:21.810593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:21.810593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:21.810593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:21.810593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:21.810593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:21.810593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:21.810593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:21.810593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:21.810593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:21.810593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:21.810593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:21.812043 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:21.812043 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:21.812043 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:16:21.812043 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 412/824] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:21.816877 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c24bd4-fb56-4e0e-b1e5-a71d1f32c7d6 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:21.929135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c24bd4-fb56-4e0e-b1e5-a71d1f32c7d6 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:21.963849 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:21.976296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbcb4e-6f88-47a3-bfc1-8d1ee2132cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:21.977026 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbcb4e-6f88-47a3-bfc1-8d1ee2132cf8 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:21.977334 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbcb4e-6f88-47a3-bfc1-8d1ee2132cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:21.977625 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbcb4e-6f88-47a3-bfc1-8d1ee2132cf8 None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:21.978303 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbcb4e-6f88-47a3-bfc1-8d1ee2132cf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:21.978636 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbcb4e-6f88-47a3-bfc1-8d1ee2132cf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:21.980120 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbcb4e-6f88-47a3-bfc1-8d1ee2132cf8 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:21.994489 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 413/825] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:21.998981 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe70bc7-ad0b-4d15-b00d-9353e6472fd9 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:22.071871 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:22.138495 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe70bc7-ad0b-4d15-b00d-9353e6472fd9 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:22.181748 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b920609-cc61-4376-9ff2-aa5745637a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:22.182352 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b920609-cc61-4376-9ff2-aa5745637a9c None admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:22.182635 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b920609-cc61-4376-9ff2-aa5745637a9c None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:22.182899 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b920609-cc61-4376-9ff2-aa5745637a9c None admin] PATH_INFO: `/v3/users` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:22.183845 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b920609-cc61-4376-9ff2-aa5745637a9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:22.185325 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b920609-cc61-4376-9ff2-aa5745637a9c None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:22.206506 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 413/826] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 00:16:21 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:16:24.628054 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967edee-6cad-4013-a5ff-2a96149daa03 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:24.628816 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967edee-6cad-4013-a5ff-2a96149daa03 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:24.628816 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967edee-6cad-4013-a5ff-2a96149daa03 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:24.630174 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 414/827] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:16:24.636242 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0c1db-5500-4ba1-88ab-430937dfbfe5 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:24.636946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0c1db-5500-4ba1-88ab-430937dfbfe5 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:24.637277 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0c1db-5500-4ba1-88ab-430937dfbfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:24.657644 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-4bb0c1db-5500-4ba1-88ab-430937dfbfe5 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:24.659239 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-4bb0c1db-5500-4ba1-88ab-430937dfbfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:24.735289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 414/828] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:24 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:25.101837 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967edee-6cad-4013-a5ff-2a96149daa03 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:25.223515 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967edee-6cad-4013-a5ff-2a96149daa03 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:25.259460 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17987867-8e02-4f12-b1df-786586f827a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:25.260075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17987867-8e02-4f12-b1df-786586f827a9 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:25.260356 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17987867-8e02-4f12-b1df-786586f827a9 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:25.260628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17987867-8e02-4f12-b1df-786586f827a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:25.272348 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17987867-8e02-4f12-b1df-786586f827a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:16:25.277116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-17987867-8e02-4f12-b1df-786586f827a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:16:25.277116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:25.277116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:25.277116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:25.277116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:25.277116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:25.277116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:25.277116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:25.277116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:25.277116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:25.277116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:25.277116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:25.277116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:16:25.277116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:16:25.277116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:16:25.277116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:16:25.278229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:16:25.278229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:16:25.278229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:16:25.278229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:16:25.278229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:25.278229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:25.278229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:25.278229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:25.278229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:25.278229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:25.278229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:25.278229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:25.278229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:25.278229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:25.278229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:25.278229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:25.279172 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:25.279172 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:25.279172 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:25.279172 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:25.279172 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:16:25.279172 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:16:25.279172 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:16:25.279172 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:16:25.279172 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:16:25.279172 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:16:25.279172 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:16:25.279172 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:16:25.279172 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 415/829] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 00:16:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:25.284935 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0c1db-5500-4ba1-88ab-430937dfbfe5 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:25.329118 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:25.395852 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0c1db-5500-4ba1-88ab-430937dfbfe5 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:25.434729 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc30525-8c22-43c1-8821-ed095bf6d13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:25.435641 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc30525-8c22-43c1-8821-ed095bf6d13b None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:25.436261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc30525-8c22-43c1-8821-ed095bf6d13b None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:25.436410 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc30525-8c22-43c1-8821-ed095bf6d13b None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:25.437026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc30525-8c22-43c1-8821-ed095bf6d13b None admin] RBAC: Adding query filter params (name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:25.437327 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc30525-8c22-43c1-8821-ed095bf6d13b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:25.438726 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc30525-8c22-43c1-8821-ed095bf6d13b None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:25.447621 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 415/830] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 00:16:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:25.453444 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17987867-8e02-4f12-b1df-786586f827a9 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:25.503940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:25.572473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17987867-8e02-4f12-b1df-786586f827a9 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:25.609368 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3548bcd-9055-4cbe-a9f9-bff8635ecdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:25.609985 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3548bcd-9055-4cbe-a9f9-bff8635ecdfb None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:25.610268 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3548bcd-9055-4cbe-a9f9-bff8635ecdfb None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:25.610537 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3548bcd-9055-4cbe-a9f9-bff8635ecdfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:25.622588 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3548bcd-9055-4cbe-a9f9-bff8635ecdfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:25.624069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3548bcd-9055-4cbe-a9f9-bff8635ecdfb None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:25.639393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-a3548bcd-9055-4cbe-a9f9-bff8635ecdfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:25.639393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:25.639393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:25.639393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:25.639393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:25.639393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:25.639393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:25.639393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:25.639393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:25.639393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:25.639393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:25.639393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:25.639393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:25.639393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:25.639393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:25.639393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:25.645733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:25.645733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:25.645733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:25.645733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:25.645733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:25.645733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:25.645733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:25.645733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:25.645733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:25.645733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:25.645733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:25.645733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:25.645733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:25.645733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:25.645733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:25.645733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:25.645733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:25.647062 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:25.647062 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:25.647062 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:16:25.647062 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 416/831] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:16:25.647322 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc30525-8c22-43c1-8821-ed095bf6d13b None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:25.754707 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:25.758215 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc30525-8c22-43c1-8821-ed095bf6d13b None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:25.793610 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24003436-eb56-4c46-9dcc-f58c23639b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:25.794219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24003436-eb56-4c46-9dcc-f58c23639b7d None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:25.794501 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24003436-eb56-4c46-9dcc-f58c23639b7d None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:25.794781 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24003436-eb56-4c46-9dcc-f58c23639b7d None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:25.795459 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24003436-eb56-4c46-9dcc-f58c23639b7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:25.795765 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24003436-eb56-4c46-9dcc-f58c23639b7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:25.797156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24003436-eb56-4c46-9dcc-f58c23639b7d None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:25.810935 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 416/832] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:25.817101 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3548bcd-9055-4cbe-a9f9-bff8635ecdfb None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:25.927982 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:25.932262 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3548bcd-9055-4cbe-a9f9-bff8635ecdfb None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:25.966850 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc8d65-9526-4c1a-b9c3-2533f72981e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:25.967508 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc8d65-9526-4c1a-b9c3-2533f72981e6 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:25.967792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc8d65-9526-4c1a-b9c3-2533f72981e6 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:25.968066 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc8d65-9526-4c1a-b9c3-2533f72981e6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:25.975661 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc8d65-9526-4c1a-b9c3-2533f72981e6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:25.977667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc8d65-9526-4c1a-b9c3-2533f72981e6 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:25.988749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-f7dc8d65-9526-4c1a-b9c3-2533f72981e6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:16:25.988749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:25.988749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:25.988749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:25.988749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:25.988749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:25.988749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:25.988749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:25.988749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:25.988749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:25.988749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:25.988749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:25.988749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:16:25.988749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:16:25.988749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:16:25.988749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:16:25.989887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:25.989887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:25.989887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:16:25.989887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:25.989887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:16:25.989887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:25.989887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:25.989887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:25.989887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:25.989887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:25.989887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:25.989887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:25.989887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:25.989887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:25.989887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:25.989887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:25.989887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:25.989887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:25.990874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:25.990874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:25.990874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:16:25.990874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:16:25.990874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:16:25.990874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:16:25.990874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:16:25.990874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:16:25.990874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:16:25.990874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:16:25.990874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 417/833] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:25.995849 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24003436-eb56-4c46-9dcc-f58c23639b7d None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:26.108785 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24003436-eb56-4c46-9dcc-f58c23639b7d None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:26.147465 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25653152-cc75-4f11-a668-a07935420e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:26.148102 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25653152-cc75-4f11-a668-a07935420e84 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:26.150529 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25653152-cc75-4f11-a668-a07935420e84 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:26.150807 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25653152-cc75-4f11-a668-a07935420e84 None admin] PATH_INFO: `/v3/users` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:26.151648 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25653152-cc75-4f11-a668-a07935420e84 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:26.151974 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25653152-cc75-4f11-a668-a07935420e84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:26.153857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25653152-cc75-4f11-a668-a07935420e84 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:26.173059 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 417/834] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 24 00:16:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:26.178793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc8d65-9526-4c1a-b9c3-2533f72981e6 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:26.288090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc8d65-9526-4c1a-b9c3-2533f72981e6 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:26.324508 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa464c-bd25-4d54-ac86-bdccc2bdc159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:26.325126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa464c-bd25-4d54-ac86-bdccc2bdc159 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:26.325402 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa464c-bd25-4d54-ac86-bdccc2bdc159 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:26.325684 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa464c-bd25-4d54-ac86-bdccc2bdc159 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:26.354177 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:26.398026 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa464c-bd25-4d54-ac86-bdccc2bdc159 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:26.399578 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa464c-bd25-4d54-ac86-bdccc2bdc159 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:26.506432 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 418/835] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:16:26 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 00:16:26.512753 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25653152-cc75-4f11-a668-a07935420e84 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:26.534340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:26.623608 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25653152-cc75-4f11-a668-a07935420e84 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:26.667774 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa8949-c3b6-468f-b95a-78d037a4e118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:26.668471 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa8949-c3b6-468f-b95a-78d037a4e118 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:26.668703 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa8949-c3b6-468f-b95a-78d037a4e118 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:26.668948 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa8949-c3b6-468f-b95a-78d037a4e118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:26.681904 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa8949-c3b6-468f-b95a-78d037a4e118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:26.683952 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa8949-c3b6-468f-b95a-78d037a4e118 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:26.699759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-13fa8949-c3b6-468f-b95a-78d037a4e118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:26.699759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:26.699759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:26.699759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:26.699759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:26.699759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:26.699759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:26.699759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:26.699759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:26.699759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:26.699759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:26.699759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:26.699759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:26.699759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:26.699759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:26.699759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:26.700984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:26.700984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:26.700984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:26.700984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:26.700984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:26.700984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:26.700984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:26.700984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:26.700984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:26.700984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:26.700984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:26.700984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:26.700984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:26.700984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:26.700984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:26.700984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:26.700984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:26.702109 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:26.702109 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:26.702109 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:16:26.702109 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 418/836] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:26.707121 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa464c-bd25-4d54-ac86-bdccc2bdc159 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:26.772256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:26.825310 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa464c-bd25-4d54-ac86-bdccc2bdc159 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:26.862442 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672dcce-7338-48db-a51f-7cafc18f2315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:26.863139 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672dcce-7338-48db-a51f-7cafc18f2315 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:26.863415 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672dcce-7338-48db-a51f-7cafc18f2315 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:26.863682 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672dcce-7338-48db-a51f-7cafc18f2315 None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:26.864323 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672dcce-7338-48db-a51f-7cafc18f2315 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:26.864626 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672dcce-7338-48db-a51f-7cafc18f2315 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:26.865983 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672dcce-7338-48db-a51f-7cafc18f2315 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:26.878486 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 419/837] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:16:26.884750 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa8949-c3b6-468f-b95a-78d037a4e118 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:26.958934 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:26.991237 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa8949-c3b6-468f-b95a-78d037a4e118 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:27.030550 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f126f9-b34f-437b-b5ff-090d27e8a6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:27.031162 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f126f9-b34f-437b-b5ff-090d27e8a6ff None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:27.031523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f126f9-b34f-437b-b5ff-090d27e8a6ff None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:27.031843 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f126f9-b34f-437b-b5ff-090d27e8a6ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:27.040826 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f126f9-b34f-437b-b5ff-090d27e8a6ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:27.042616 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f126f9-b34f-437b-b5ff-090d27e8a6ff None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:27.057780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-e1f126f9-b34f-437b-b5ff-090d27e8a6ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:27.057780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:27.057780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:27.057780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:27.057780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:27.057780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:27.057780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:27.057780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:27.057780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:27.057780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:27.057780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:27.057780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:27.057780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:16:27.057780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:16:27.057780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:16:27.059261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:16:27.059261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:27.059261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:27.059261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:27.059261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:27.059261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:27.059261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:27.059261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:27.059261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:27.059261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:27.059261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:27.059261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:27.059261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:27.059261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:27.059261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:27.059261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:27.059261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:27.065045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:16:27.065045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:16:27.065045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:16:27.065045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:16:27.065045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:16:27.065045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:16:27.065045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:27.065045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:16:27.065045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 419/838] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:27.066930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672dcce-7338-48db-a51f-7cafc18f2315 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:27.173262 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672dcce-7338-48db-a51f-7cafc18f2315 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:27.191905 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:27.209793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a7480-16d7-416d-8350-358d0d1d5181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:27.210392 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a7480-16d7-416d-8350-358d0d1d5181 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:27.210707 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a7480-16d7-416d-8350-358d0d1d5181 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:27.210965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a7480-16d7-416d-8350-358d0d1d5181 None admin] PATH_INFO: `/v3/projects` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:27.211677 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a7480-16d7-416d-8350-358d0d1d5181 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:27.212055 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a7480-16d7-416d-8350-358d0d1d5181 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:27.213719 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a7480-16d7-416d-8350-358d0d1d5181 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:27.232401 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 420/839] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:16:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:27.233843 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f126f9-b34f-437b-b5ff-090d27e8a6ff None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:27.340286 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f126f9-b34f-437b-b5ff-090d27e8a6ff None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:27.370035 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:27.376321 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b809015-953f-4d86-ac2c-edc820fa7082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:27.376948 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b809015-953f-4d86-ac2c-edc820fa7082 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:27.377264 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b809015-953f-4d86-ac2c-edc820fa7082 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:27.377598 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b809015-953f-4d86-ac2c-edc820fa7082 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:27.378375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b809015-953f-4d86-ac2c-edc820fa7082 None admin] RBAC: Adding query filter params (role.id=85e127a1e1b348d6bf45890be6c68b1d, scope.project.id=a63a68d37106431e80bd876cdce3e5fa, user.id=ebffbdf5a1234167903a9fd4490bb174) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:27.378684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b809015-953f-4d86-ac2c-edc820fa7082 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:27.380277 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b809015-953f-4d86-ac2c-edc820fa7082 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:27.386455 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 420/840] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:16:27 2022] GET /identity/v3/role_assignments?user.id=ebffbdf5a1234167903a9fd4490bb174&scope.project.id=a63a68d37106431e80bd876cdce3e5fa&role.id=85e127a1e1b348d6bf45890be6c68b1d => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:29.725543 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472aaf7-bdb0-45b6-b74b-5b2356e7b411 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:29.726126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472aaf7-bdb0-45b6-b74b-5b2356e7b411 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:29.726126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472aaf7-bdb0-45b6-b74b-5b2356e7b411 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:29.728032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 421/841] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:16:29.733849 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccb4f3-c86d-47bb-b4d9-3aa40a08850a None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:29.734346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccb4f3-c86d-47bb-b4d9-3aa40a08850a None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:29.734452 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccb4f3-c86d-47bb-b4d9-3aa40a08850a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:29.755692 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-51ccb4f3-c86d-47bb-b4d9-3aa40a08850a None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:29.756875 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-51ccb4f3-c86d-47bb-b4d9-3aa40a08850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:29.832367 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 421/842] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:29 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:30.177129 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472aaf7-bdb0-45b6-b74b-5b2356e7b411 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:30.286261 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472aaf7-bdb0-45b6-b74b-5b2356e7b411 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:30.323744 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fbd95-3708-4ffb-9af1-2b657575f231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:30.324375 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fbd95-3708-4ffb-9af1-2b657575f231 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:30.324781 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fbd95-3708-4ffb-9af1-2b657575f231 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:30.325017 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fbd95-3708-4ffb-9af1-2b657575f231 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:30.340454 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fbd95-3708-4ffb-9af1-2b657575f231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:16:30.345306 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-8b9fbd95-3708-4ffb-9af1-2b657575f231 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:16:30.345306 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:30.345306 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:30.345306 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:30.345306 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:30.345306 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:30.345306 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:30.345306 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:30.345306 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:30.345306 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:30.345306 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:30.345306 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:30.345306 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:16:30.345306 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:16:30.345306 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:16:30.345306 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:16:30.346332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:16:30.346332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:16:30.346332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:16:30.346332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:16:30.346332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:30.346332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:30.346332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:30.346332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:30.346332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:30.346332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:30.346332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:30.346332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:30.346332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:30.346332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:30.346332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:30.346332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:30.347418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:30.347418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:30.347418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:30.347418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:30.347418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:16:30.347418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:16:30.347418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:16:30.347418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:16:30.347418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:16:30.347418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:16:30.347418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:16:30.347418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:16:30.347418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 422/843] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 00:16:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:30.353874 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccb4f3-c86d-47bb-b4d9-3aa40a08850a None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:30.479632 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccb4f3-c86d-47bb-b4d9-3aa40a08850a None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:30.507094 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:30.522832 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6cd23-7a24-4d4b-a47c-4255786b3cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:30.523614 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6cd23-7a24-4d4b-a47c-4255786b3cb5 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:30.523945 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6cd23-7a24-4d4b-a47c-4255786b3cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:30.524234 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6cd23-7a24-4d4b-a47c-4255786b3cb5 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:30.524959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6cd23-7a24-4d4b-a47c-4255786b3cb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:30.525234 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6cd23-7a24-4d4b-a47c-4255786b3cb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:30.526920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6cd23-7a24-4d4b-a47c-4255786b3cb5 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:30.535814 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 422/844] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 00:16:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:16:30.541591 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fbd95-3708-4ffb-9af1-2b657575f231 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:30.587276 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:30.652122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fbd95-3708-4ffb-9af1-2b657575f231 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:30.690668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcf9af-d86e-435b-b11c-104af0891d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:30.691325 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcf9af-d86e-435b-b11c-104af0891d37 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:30.691602 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcf9af-d86e-435b-b11c-104af0891d37 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:30.691873 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcf9af-d86e-435b-b11c-104af0891d37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:30.703111 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bcf9af-d86e-435b-b11c-104af0891d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:30.704574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bcf9af-d86e-435b-b11c-104af0891d37 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:30.722113 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-37bcf9af-d86e-435b-b11c-104af0891d37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:30.722113 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:30.722113 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:30.722113 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:30.722113 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:30.722113 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:30.722113 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:30.722113 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:30.722113 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:30.722113 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:30.722113 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:30.722113 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:30.722113 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:30.722113 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:30.722113 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:30.722113 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:30.724400 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:30.724400 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:30.724400 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:30.724400 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:30.724400 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:30.724400 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:30.724400 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:30.724400 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:30.724400 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:30.724400 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:30.724400 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:30.724400 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:30.724400 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:30.724400 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:30.724400 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:30.724400 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:30.724400 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:30.726924 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:30.726924 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:30.726924 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:16:30.726924 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 423/845] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:30.733141 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6cd23-7a24-4d4b-a47c-4255786b3cb5 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:30.870456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6cd23-7a24-4d4b-a47c-4255786b3cb5 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:30.908045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18c9a3-f2fa-4d42-9dc7-c9b5980f9d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:30.908738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18c9a3-f2fa-4d42-9dc7-c9b5980f9d3c None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:30.909021 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18c9a3-f2fa-4d42-9dc7-c9b5980f9d3c None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:30.909284 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18c9a3-f2fa-4d42-9dc7-c9b5980f9d3c None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:30.910042 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18c9a3-f2fa-4d42-9dc7-c9b5980f9d3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:30.910770 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18c9a3-f2fa-4d42-9dc7-c9b5980f9d3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:30.911818 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18c9a3-f2fa-4d42-9dc7-c9b5980f9d3c None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:30.925485 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 423/846] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:30.932673 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcf9af-d86e-435b-b11c-104af0891d37 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:31.040127 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:31.052777 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcf9af-d86e-435b-b11c-104af0891d37 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:31.103878 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6b7c5-fc3e-43bd-a11c-01ef201c2f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:31.104505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6b7c5-fc3e-43bd-a11c-01ef201c2f3f None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:31.104787 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6b7c5-fc3e-43bd-a11c-01ef201c2f3f None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:31.105057 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6b7c5-fc3e-43bd-a11c-01ef201c2f3f None admin] PATH_INFO: `/v3/users/placement` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:31.115461 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6b7c5-fc3e-43bd-a11c-01ef201c2f3f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:31.117615 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6b7c5-fc3e-43bd-a11c-01ef201c2f3f None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:31.129349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-8bf6b7c5-fc3e-43bd-a11c-01ef201c2f3f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:16:31.129349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:31.129349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:31.129349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:31.129349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:31.129349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:31.129349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:31.129349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:31.129349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:31.129349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:31.129349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:31.129349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:31.129349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:16:31.129349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:16:31.129349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:16:31.129349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:16:31.130966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:31.130966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:31.130966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:16:31.130966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:31.130966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:16:31.130966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:31.130966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:31.130966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:31.130966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:31.130966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:31.130966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:31.130966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:31.130966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:31.130966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:31.130966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:31.130966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:31.130966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:31.130966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:31.132088 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:31.132088 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:31.132088 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:16:31.132088 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:16:31.132088 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:16:31.132088 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:16:31.132088 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:16:31.132088 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:16:31.132088 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:16:31.132088 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:16:31.132088 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 424/847] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:16:31.137608 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18c9a3-f2fa-4d42-9dc7-c9b5980f9d3c None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:31.194758 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:31.262721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18c9a3-f2fa-4d42-9dc7-c9b5980f9d3c None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:31.303930 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059de191-b77a-4016-9e73-87cda4cbadd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:31.304984 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de191-b77a-4016-9e73-87cda4cbadd6 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:31.305265 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de191-b77a-4016-9e73-87cda4cbadd6 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:31.305533 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de191-b77a-4016-9e73-87cda4cbadd6 None admin] PATH_INFO: `/v3/users` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:31.306285 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059de191-b77a-4016-9e73-87cda4cbadd6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:31.306592 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059de191-b77a-4016-9e73-87cda4cbadd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:31.308309 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059de191-b77a-4016-9e73-87cda4cbadd6 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:31.330116 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 424/848] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 24 00:16:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:31.336112 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6b7c5-fc3e-43bd-a11c-01ef201c2f3f None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:31.461431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6b7c5-fc3e-43bd-a11c-01ef201c2f3f None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:31.498558 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72877dc7-275d-4d1c-ab07-88c87bb126f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:31.499227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72877dc7-275d-4d1c-ab07-88c87bb126f1 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:31.499518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72877dc7-275d-4d1c-ab07-88c87bb126f1 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:31.499794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72877dc7-275d-4d1c-ab07-88c87bb126f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:31.513497 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72877dc7-275d-4d1c-ab07-88c87bb126f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:31.515110 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72877dc7-275d-4d1c-ab07-88c87bb126f1 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:31.531140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-72877dc7-275d-4d1c-ab07-88c87bb126f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:31.531140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:31.531140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:31.531140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:31.531140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:31.531140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:31.531140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:31.531140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:31.531140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:31.531140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:31.531140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:31.531140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:31.531140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:31.531140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:31.531140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:31.531140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:31.532355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:31.532355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:31.532355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:31.532355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:31.532355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:31.532355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:31.532355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:31.532355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:31.532355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:31.532355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:31.532355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:31.532355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:31.532355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:31.532355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:31.532355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:31.532355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:31.532355 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:31.533537 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:31.533537 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:31.533537 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:16:31.533537 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 425/849] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:31.538928 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059de191-b77a-4016-9e73-87cda4cbadd6 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:31.671651 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059de191-b77a-4016-9e73-87cda4cbadd6 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:31.674456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:31.718660 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf68018-41a8-47fb-b5f8-134068e50408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:31.719307 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf68018-41a8-47fb-b5f8-134068e50408 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:31.719587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf68018-41a8-47fb-b5f8-134068e50408 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:31.719875 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf68018-41a8-47fb-b5f8-134068e50408 None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:31.720774 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf68018-41a8-47fb-b5f8-134068e50408 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:31.721092 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf68018-41a8-47fb-b5f8-134068e50408 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:31.722766 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf68018-41a8-47fb-b5f8-134068e50408 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:31.735244 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 425/850] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:31.741562 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72877dc7-275d-4d1c-ab07-88c87bb126f1 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:31.745949 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:31.871544 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72877dc7-275d-4d1c-ab07-88c87bb126f1 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:31.911050 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74bd37-0cd8-4859-9f65-f3c1d05ee684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:31.911715 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74bd37-0cd8-4859-9f65-f3c1d05ee684 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:31.911998 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74bd37-0cd8-4859-9f65-f3c1d05ee684 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:31.912302 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74bd37-0cd8-4859-9f65-f3c1d05ee684 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:31.919802 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74bd37-0cd8-4859-9f65-f3c1d05ee684 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:31.921298 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74bd37-0cd8-4859-9f65-f3c1d05ee684 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:31.934128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-1f74bd37-0cd8-4859-9f65-f3c1d05ee684 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:31.934128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:31.934128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:31.934128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:31.934128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:31.934128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:31.934128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:31.934128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:31.934128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:31.934128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:31.934128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:31.934128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:31.934128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:16:31.934128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:16:31.934128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:16:31.935151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:16:31.935151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:31.935151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:31.935151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:31.935151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:31.935151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:31.935151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:31.935151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:31.935151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:31.935151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:31.935151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:31.935151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:31.935151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:31.935151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:31.935151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:31.935151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:31.935151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:31.936169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:16:31.936169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:16:31.936169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:16:31.936169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:16:31.936169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:16:31.936169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:16:31.936169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:31.936169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:16:31.936169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 426/851] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:16:31.941706 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf68018-41a8-47fb-b5f8-134068e50408 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:32.061516 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf68018-41a8-47fb-b5f8-134068e50408 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:32.106021 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df6076-3aa5-4828-b46a-21babaca165d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:32.106630 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df6076-3aa5-4828-b46a-21babaca165d None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:32.106907 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df6076-3aa5-4828-b46a-21babaca165d None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:32.107206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df6076-3aa5-4828-b46a-21babaca165d None admin] PATH_INFO: `/v3/projects` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:32.107896 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df6076-3aa5-4828-b46a-21babaca165d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:32.108201 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df6076-3aa5-4828-b46a-21babaca165d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:32.109641 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df6076-3aa5-4828-b46a-21babaca165d None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:32.122983 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 426/852] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:16:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:32.130312 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74bd37-0cd8-4859-9f65-f3c1d05ee684 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:32.201771 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:32.251482 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74bd37-0cd8-4859-9f65-f3c1d05ee684 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:32.294762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf87813-a29d-4f7e-a455-389e19182e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:32.295483 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf87813-a29d-4f7e-a455-389e19182e28 None admin] REQUEST_METHOD: `PUT` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:32.295762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf87813-a29d-4f7e-a455-389e19182e28 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:32.296037 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf87813-a29d-4f7e-a455-389e19182e28 None admin] PATH_INFO: `/v3/projects/a63a68d37106431e80bd876cdce3e5fa/users/ebffbdf5a1234167903a9fd4490bb174/roles/85e127a1e1b348d6bf45890be6c68b1d` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:32.314986 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf87813-a29d-4f7e-a455-389e19182e28 None admin] RBAC: Authorizing `identity:create_grant(project_id=a63a68d37106431e80bd876cdce3e5fa, user_id=ebffbdf5a1234167903a9fd4490bb174, role_id=85e127a1e1b348d6bf45890be6c68b1d)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:32.316557 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf87813-a29d-4f7e-a455-389e19182e28 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:32.339994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 427/853] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 00:16:32 2022] PUT /identity/v3/projects/a63a68d37106431e80bd876cdce3e5fa/users/ebffbdf5a1234167903a9fd4490bb174/roles/85e127a1e1b348d6bf45890be6c68b1d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:16:34.677294 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2b873-c10b-470d-8b25-f19e86608d3e None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:34.678055 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2b873-c10b-470d-8b25-f19e86608d3e None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:34.678055 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2b873-c10b-470d-8b25-f19e86608d3e None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:34.679521 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 427/854] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:34.686876 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42772c-d0a9-4d7a-8175-9fb2dd3122cb None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:34.687634 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42772c-d0a9-4d7a-8175-9fb2dd3122cb None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:34.687634 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42772c-d0a9-4d7a-8175-9fb2dd3122cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:34.708987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-fc42772c-d0a9-4d7a-8175-9fb2dd3122cb None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:34.710302 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-fc42772c-d0a9-4d7a-8175-9fb2dd3122cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:34.791395 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 428/855] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:34 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:35.138020 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2b873-c10b-470d-8b25-f19e86608d3e None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:35.168970 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:35.266332 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2b873-c10b-470d-8b25-f19e86608d3e None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:35.307021 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491ca7a-3c35-4c91-85ad-cd9758a7132e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:35.308115 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491ca7a-3c35-4c91-85ad-cd9758a7132e None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:35.308411 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491ca7a-3c35-4c91-85ad-cd9758a7132e None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:35.308697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491ca7a-3c35-4c91-85ad-cd9758a7132e None admin] PATH_INFO: `/v3/roles/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:35.326131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491ca7a-3c35-4c91-85ad-cd9758a7132e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:16:35.330841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-7491ca7a-3c35-4c91-85ad-cd9758a7132e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:16:35.330841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:35.330841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:35.330841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:35.330841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:35.330841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:35.330841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:35.330841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:35.330841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:35.330841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:35.330841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:35.330841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:35.330841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:16:35.330841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:16:35.330841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:16:35.330841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:16:35.331927 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:16:35.331927 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:16:35.331927 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:16:35.331927 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:16:35.331927 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:35.331927 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:35.331927 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:35.331927 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:35.331927 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:35.331927 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:35.331927 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:35.331927 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:35.331927 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:35.331927 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:35.331927 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:35.331927 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:35.332830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:35.332830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:35.332830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:35.332830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:35.332830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:16:35.332830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:16:35.332830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:16:35.332830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:16:35.332830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:16:35.332830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:16:35.332830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 00:16:35.332830 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:16:35.335260 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 428/856] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 00:16:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:35.338937 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42772c-d0a9-4d7a-8175-9fb2dd3122cb None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:35.387827 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:35.452574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42772c-d0a9-4d7a-8175-9fb2dd3122cb None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:35.488500 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc432a27-ea85-4082-821e-4be4dbbf91ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:35.489099 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc432a27-ea85-4082-821e-4be4dbbf91ce None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:35.489374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc432a27-ea85-4082-821e-4be4dbbf91ce None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:35.489643 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc432a27-ea85-4082-821e-4be4dbbf91ce None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:35.490315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc432a27-ea85-4082-821e-4be4dbbf91ce None admin] RBAC: Adding query filter params (name=service) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:35.490616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc432a27-ea85-4082-821e-4be4dbbf91ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:35.492135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc432a27-ea85-4082-821e-4be4dbbf91ce None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:35.500919 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 429/857] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 00:16:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:35.507043 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491ca7a-3c35-4c91-85ad-cd9758a7132e None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:35.628126 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:35.647078 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491ca7a-3c35-4c91-85ad-cd9758a7132e None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:35.687443 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dde7a-2c16-4d62-bcc5-12204e75915f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:35.688297 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dde7a-2c16-4d62-bcc5-12204e75915f None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:35.688549 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dde7a-2c16-4d62-bcc5-12204e75915f None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:35.689030 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dde7a-2c16-4d62-bcc5-12204e75915f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:35.701683 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dde7a-2c16-4d62-bcc5-12204e75915f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:35.703284 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dde7a-2c16-4d62-bcc5-12204e75915f None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:35.722387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-5e9dde7a-2c16-4d62-bcc5-12204e75915f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:35.722387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:35.722387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:35.722387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:35.722387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:35.722387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:35.722387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:35.722387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:35.722387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:35.722387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:35.722387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:35.722387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:35.722387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:35.722387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:35.722387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:35.722387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:35.723711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:35.723711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:35.723711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:35.723711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:35.723711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:35.723711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:35.723711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:35.723711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:35.723711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:35.723711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:35.723711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:35.723711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:35.723711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:35.723711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:35.723711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:35.723711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:35.723711 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:35.724690 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:35.724690 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:35.724690 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:16:35.724690 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 429/858] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:35.731721 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc432a27-ea85-4082-821e-4be4dbbf91ce None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:35.851990 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc432a27-ea85-4082-821e-4be4dbbf91ce None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:35.854587 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:35.896316 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6556d1-def2-4c7d-893e-32bb84de9cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:35.896927 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6556d1-def2-4c7d-893e-32bb84de9cf1 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:35.897204 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6556d1-def2-4c7d-893e-32bb84de9cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:35.897471 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6556d1-def2-4c7d-893e-32bb84de9cf1 None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:35.898118 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6556d1-def2-4c7d-893e-32bb84de9cf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:35.898411 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6556d1-def2-4c7d-893e-32bb84de9cf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:35.899878 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6556d1-def2-4c7d-893e-32bb84de9cf1 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:35.913334 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 430/859] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:35.919568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dde7a-2c16-4d62-bcc5-12204e75915f None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:36.039745 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dde7a-2c16-4d62-bcc5-12204e75915f None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:36.086288 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb8e25-5df9-4539-a500-334823b8f1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:36.086918 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb8e25-5df9-4539-a500-334823b8f1d9 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:36.087234 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb8e25-5df9-4539-a500-334823b8f1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:36.087511 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb8e25-5df9-4539-a500-334823b8f1d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:36.092005 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:36.099619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb8e25-5df9-4539-a500-334823b8f1d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:36.102102 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb8e25-5df9-4539-a500-334823b8f1d9 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:36.115622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-aafb8e25-5df9-4539-a500-334823b8f1d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:16:36.115622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:36.115622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:36.115622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:36.115622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:36.115622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:36.115622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:36.115622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:36.115622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:36.115622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:36.115622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:36.115622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:36.115622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:16:36.115622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:16:36.115622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:16:36.115622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:16:36.117104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:36.117104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:36.117104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:16:36.117104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:36.117104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:16:36.117104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:36.117104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:36.117104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:36.117104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:36.117104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:36.117104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:36.117104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:36.117104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:36.117104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:36.117104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:36.117104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:36.117104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:36.117104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:36.118115 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:36.118115 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:36.118115 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:16:36.118115 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:16:36.118115 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:16:36.118115 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:16:36.118115 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:16:36.118115 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:16:36.118115 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:16:36.118115 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:16:36.118115 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 430/860] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:36.124145 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6556d1-def2-4c7d-893e-32bb84de9cf1 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:36.241653 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6556d1-def2-4c7d-893e-32bb84de9cf1 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:36.282311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb42a97-c763-4bb8-8d99-9d6034c47604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:36.283045 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb42a97-c763-4bb8-8d99-9d6034c47604 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:36.283358 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb42a97-c763-4bb8-8d99-9d6034c47604 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:36.283674 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb42a97-c763-4bb8-8d99-9d6034c47604 None admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:36.284704 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb42a97-c763-4bb8-8d99-9d6034c47604 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:36.285046 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb42a97-c763-4bb8-8d99-9d6034c47604 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:36.286972 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb42a97-c763-4bb8-8d99-9d6034c47604 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:36.311050 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 431/861] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 24 00:16:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:36.316796 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb8e25-5df9-4539-a500-334823b8f1d9 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:36.443083 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb8e25-5df9-4539-a500-334823b8f1d9 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:36.483789 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7763e-fc66-47ba-a9da-21a3efe02477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:36.484409 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7763e-fc66-47ba-a9da-21a3efe02477 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:36.484684 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7763e-fc66-47ba-a9da-21a3efe02477 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:36.484953 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7763e-fc66-47ba-a9da-21a3efe02477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:36.561538 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:36.570348 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7763e-fc66-47ba-a9da-21a3efe02477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:36.571862 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7763e-fc66-47ba-a9da-21a3efe02477 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:36.693554 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 431/862] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:16:36 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 00:16:36.699992 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb42a97-c763-4bb8-8d99-9d6034c47604 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:36.735576 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:36.832641 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb42a97-c763-4bb8-8d99-9d6034c47604 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:36.872994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b80792-3b9a-428f-bdeb-c586f269143c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:36.873661 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b80792-3b9a-428f-bdeb-c586f269143c None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:36.873944 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b80792-3b9a-428f-bdeb-c586f269143c None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:36.874219 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b80792-3b9a-428f-bdeb-c586f269143c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:36.888399 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b80792-3b9a-428f-bdeb-c586f269143c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:36.890201 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b80792-3b9a-428f-bdeb-c586f269143c None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:36.913072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-06b80792-3b9a-428f-bdeb-c586f269143c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:36.913072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:36.913072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:36.913072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:36.913072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:36.913072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:36.913072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:36.913072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:36.913072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:36.913072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:36.913072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:36.913072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:36.913072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:36.913072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:36.913072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:36.913072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:36.914418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:36.914418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:36.914418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:36.914418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:36.914418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:36.914418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:36.914418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:36.914418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:36.914418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:36.914418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:36.914418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:36.914418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:36.914418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:36.914418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:36.914418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:36.914418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:36.914418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:36.915336 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:36.915336 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:36.915336 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:16:36.915336 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 432/863] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:36.920794 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7763e-fc66-47ba-a9da-21a3efe02477 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:37.036566 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:37.044756 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7763e-fc66-47ba-a9da-21a3efe02477 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:37.089281 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a969f5c-bfb5-43ae-a50d-bd0d43ebdc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:37.090225 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a969f5c-bfb5-43ae-a50d-bd0d43ebdc4a None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:37.090577 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a969f5c-bfb5-43ae-a50d-bd0d43ebdc4a None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:37.090950 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a969f5c-bfb5-43ae-a50d-bd0d43ebdc4a None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:37.091986 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a969f5c-bfb5-43ae-a50d-bd0d43ebdc4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:37.092312 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a969f5c-bfb5-43ae-a50d-bd0d43ebdc4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:37.094201 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a969f5c-bfb5-43ae-a50d-bd0d43ebdc4a None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:37.116489 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 432/864] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:37.117755 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b80792-3b9a-428f-bdeb-c586f269143c None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:37.213992 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:37.243850 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b80792-3b9a-428f-bdeb-c586f269143c None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:37.283886 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b12b5-3324-40be-9f6e-d4fe338df5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:37.284602 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b12b5-3324-40be-9f6e-d4fe338df5bb None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:37.284886 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b12b5-3324-40be-9f6e-d4fe338df5bb None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:37.285162 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b12b5-3324-40be-9f6e-d4fe338df5bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:37.292832 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b12b5-3324-40be-9f6e-d4fe338df5bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:37.294466 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b12b5-3324-40be-9f6e-d4fe338df5bb None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:37.307242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-c63b12b5-3324-40be-9f6e-d4fe338df5bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:37.307242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:37.307242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:37.307242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:37.307242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:37.307242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:37.307242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:37.307242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:37.307242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:37.307242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:37.307242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:37.307242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:37.307242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:16:37.307242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:16:37.307242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:16:37.308676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:16:37.308676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:37.308676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:37.308676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:37.308676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:37.308676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:37.308676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:37.308676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:37.308676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:37.308676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:37.308676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:37.308676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:37.308676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:37.308676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:37.308676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:37.308676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:37.308676 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:37.310117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:16:37.310117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:16:37.310117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:16:37.310117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:16:37.310117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:16:37.310117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:16:37.310117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:37.310117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:16:37.310117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 433/865] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:37.314679 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a969f5c-bfb5-43ae-a50d-bd0d43ebdc4a None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:37.438512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a969f5c-bfb5-43ae-a50d-bd0d43ebdc4a None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:37.479436 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100d7cc-674d-466e-80ee-260b232a4649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:37.480184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100d7cc-674d-466e-80ee-260b232a4649 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:37.480514 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100d7cc-674d-466e-80ee-260b232a4649 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:37.480862 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100d7cc-674d-466e-80ee-260b232a4649 None admin] PATH_INFO: `/v3/projects` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:37.481585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100d7cc-674d-466e-80ee-260b232a4649 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:37.481864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100d7cc-674d-466e-80ee-260b232a4649 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:37.483385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100d7cc-674d-466e-80ee-260b232a4649 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:37.500019 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 433/866] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:16:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:37.506753 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b12b5-3324-40be-9f6e-d4fe338df5bb None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:37.631046 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b12b5-3324-40be-9f6e-d4fe338df5bb None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:37.670100 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f949362-981c-40f4-a559-b0f6d3ebe360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:37.670724 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f949362-981c-40f4-a559-b0f6d3ebe360 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:37.671022 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f949362-981c-40f4-a559-b0f6d3ebe360 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:37.671443 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f949362-981c-40f4-a559-b0f6d3ebe360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:37.672239 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f949362-981c-40f4-a559-b0f6d3ebe360 None admin] RBAC: Adding query filter params (role.id=85e127a1e1b348d6bf45890be6c68b1d, scope.project.id=a63a68d37106431e80bd876cdce3e5fa, user.id=ebffbdf5a1234167903a9fd4490bb174) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:37.672550 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f949362-981c-40f4-a559-b0f6d3ebe360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:37.675458 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f949362-981c-40f4-a559-b0f6d3ebe360 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:37.677923 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:37.687350 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 434/867] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:16:37 2022] GET /identity/v3/role_assignments?user.id=ebffbdf5a1234167903a9fd4490bb174&scope.project.id=a63a68d37106431e80bd876cdce3e5fa&role.id=85e127a1e1b348d6bf45890be6c68b1d => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:40.063561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c85bcd-e59d-48cd-bc9c-35bacbff78dc None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:40.064237 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c85bcd-e59d-48cd-bc9c-35bacbff78dc None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:40.064237 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c85bcd-e59d-48cd-bc9c-35bacbff78dc None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:40.065476 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 434/868] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:40.072165 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63d473-56cb-4bb4-b072-1f1b7c96d4d7 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:40.072751 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63d473-56cb-4bb4-b072-1f1b7c96d4d7 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:40.072751 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63d473-56cb-4bb4-b072-1f1b7c96d4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:40.093685 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-4b63d473-56cb-4bb4-b072-1f1b7c96d4d7 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:40.094893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-4b63d473-56cb-4bb4-b072-1f1b7c96d4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:40.173162 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 435/869] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:40 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:40.497959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c85bcd-e59d-48cd-bc9c-35bacbff78dc None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:40.521712 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:40.634677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c85bcd-e59d-48cd-bc9c-35bacbff78dc None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:40.673411 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e31522-457c-46b9-bdc3-2dcb0071e759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:40.674112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e31522-457c-46b9-bdc3-2dcb0071e759 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:40.674504 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e31522-457c-46b9-bdc3-2dcb0071e759 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:40.674874 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e31522-457c-46b9-bdc3-2dcb0071e759 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:40.687462 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e31522-457c-46b9-bdc3-2dcb0071e759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:16:40.692327 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-20e31522-457c-46b9-bdc3-2dcb0071e759 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:16:40.692327 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:40.692327 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:40.692327 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:40.692327 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:40.692327 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:40.692327 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:40.692327 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:40.692327 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:40.692327 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:40.692327 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:40.692327 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:40.692327 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:16:40.692327 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:16:40.692327 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:16:40.692327 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:16:40.695170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:16:40.695170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:16:40.695170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:16:40.695170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:16:40.695170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:40.695170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:40.695170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:40.695170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:40.695170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:40.695170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:40.695170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:40.695170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:40.695170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:40.695170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:40.695170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:40.695170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:40.696344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:40.696344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:40.696344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:40.696344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:40.696344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:16:40.696344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:16:40.696344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:16:40.696344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:16:40.696344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:16:40.696344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:16:40.696344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:16:40.696344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:16:40.696344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 435/870] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 00:16:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:40.699664 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63d473-56cb-4bb4-b072-1f1b7c96d4d7 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:40.809500 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63d473-56cb-4bb4-b072-1f1b7c96d4d7 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:40.838794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:40.848792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32e2fe-9475-4137-badc-85ba2ba4439e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:40.849650 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32e2fe-9475-4137-badc-85ba2ba4439e None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:40.849934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32e2fe-9475-4137-badc-85ba2ba4439e None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:40.850210 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32e2fe-9475-4137-badc-85ba2ba4439e None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:40.851442 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32e2fe-9475-4137-badc-85ba2ba4439e None admin] RBAC: Adding query filter params (name=admin) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:40.851908 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32e2fe-9475-4137-badc-85ba2ba4439e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:40.853574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32e2fe-9475-4137-badc-85ba2ba4439e None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:40.867027 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 436/871] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:16:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:40.870619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e31522-457c-46b9-bdc3-2dcb0071e759 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:40.962803 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:40.990058 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e31522-457c-46b9-bdc3-2dcb0071e759 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:41.036639 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452c812-704b-4815-a49c-4a748a6b1f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:41.037374 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452c812-704b-4815-a49c-4a748a6b1f2f None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:41.037656 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452c812-704b-4815-a49c-4a748a6b1f2f None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:41.037958 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452c812-704b-4815-a49c-4a748a6b1f2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:41.051948 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452c812-704b-4815-a49c-4a748a6b1f2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:41.054062 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452c812-704b-4815-a49c-4a748a6b1f2f None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:41.072340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-5452c812-704b-4815-a49c-4a748a6b1f2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:41.072340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:41.072340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:41.072340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:41.072340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:41.072340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:41.072340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:41.072340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:41.072340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:41.072340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:41.072340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:41.072340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:41.072340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:41.072340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:41.072340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:41.072340 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:41.074219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:41.074219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:41.074219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:41.074219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:41.074219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:41.074219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:41.074219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:41.074219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:41.074219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:41.074219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:41.074219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:41.074219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:41.074219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:41.074219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:41.074219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:41.074219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:41.074219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:41.075433 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:41.075433 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:41.075433 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:16:41.075433 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 436/872] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:16:41.086764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32e2fe-9475-4137-badc-85ba2ba4439e None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:41.199062 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32e2fe-9475-4137-badc-85ba2ba4439e None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:41.237242 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eff131-d233-447a-89de-9ea213f19f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:41.237845 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eff131-d233-447a-89de-9ea213f19f08 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:41.238169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eff131-d233-447a-89de-9ea213f19f08 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:41.239515 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eff131-d233-447a-89de-9ea213f19f08 None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:41.239515 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eff131-d233-447a-89de-9ea213f19f08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:41.239515 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eff131-d233-447a-89de-9ea213f19f08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:41.240736 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eff131-d233-447a-89de-9ea213f19f08 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:41.253223 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 437/873] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:41.259137 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452c812-704b-4815-a49c-4a748a6b1f2f None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:41.373616 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452c812-704b-4815-a49c-4a748a6b1f2f None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:41.402861 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:41.411688 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefad337-dcca-47db-93c1-6eaace91a2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:41.412322 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefad337-dcca-47db-93c1-6eaace91a2a4 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:41.412603 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefad337-dcca-47db-93c1-6eaace91a2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:41.412875 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefad337-dcca-47db-93c1-6eaace91a2a4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:41.421514 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefad337-dcca-47db-93c1-6eaace91a2a4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:41.423114 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefad337-dcca-47db-93c1-6eaace91a2a4 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:41.435263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-fefad337-dcca-47db-93c1-6eaace91a2a4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:16:41.435263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:41.435263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:41.435263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:41.435263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:41.435263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:41.435263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:41.435263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:41.435263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:41.435263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:41.435263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:41.435263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:41.435263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:16:41.435263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:16:41.435263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:16:41.435263 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:16:41.436456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:41.436456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:41.436456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:16:41.436456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:41.436456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:16:41.436456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:41.436456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:41.436456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:41.436456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:41.436456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:41.436456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:41.436456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:41.436456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:41.436456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:41.436456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:41.436456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:41.436456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:41.436456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:41.437392 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:41.437392 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:41.437392 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:16:41.437392 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:16:41.437392 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:16:41.437392 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:16:41.437392 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:16:41.437392 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:16:41.437392 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:16:41.437392 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:16:41.437392 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 437/874] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:41.442516 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eff131-d233-447a-89de-9ea213f19f08 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:41.495853 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:41.554140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eff131-d233-447a-89de-9ea213f19f08 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:41.591391 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e24f3-47a8-4340-bb50-8342b7571a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:41.592005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e24f3-47a8-4340-bb50-8342b7571a8c None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:41.592285 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e24f3-47a8-4340-bb50-8342b7571a8c None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:41.592554 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e24f3-47a8-4340-bb50-8342b7571a8c None admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:41.593302 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e24f3-47a8-4340-bb50-8342b7571a8c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:41.593609 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e24f3-47a8-4340-bb50-8342b7571a8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:41.595100 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e24f3-47a8-4340-bb50-8342b7571a8c None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:41.615666 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 438/875] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 24 00:16:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:41.621703 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefad337-dcca-47db-93c1-6eaace91a2a4 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:41.735552 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefad337-dcca-47db-93c1-6eaace91a2a4 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:41.773149 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dc591-87b8-414c-913d-c07d205b2068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:41.774488 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dc591-87b8-414c-913d-c07d205b2068 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:41.774488 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dc591-87b8-414c-913d-c07d205b2068 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:41.774488 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dc591-87b8-414c-913d-c07d205b2068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:41.832092 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:41.844691 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7dc591-87b8-414c-913d-c07d205b2068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:41.846269 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7dc591-87b8-414c-913d-c07d205b2068 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:41.946681 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 438/876] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:16:41 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 00:16:41.952243 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e24f3-47a8-4340-bb50-8342b7571a8c None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:42.060884 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e24f3-47a8-4340-bb50-8342b7571a8c None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:42.071507 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:42.095547 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23d240-65db-4e5c-a611-24b323cdcecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:42.096162 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23d240-65db-4e5c-a611-24b323cdcecd None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:42.096434 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23d240-65db-4e5c-a611-24b323cdcecd None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:42.096698 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23d240-65db-4e5c-a611-24b323cdcecd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:42.106854 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23d240-65db-4e5c-a611-24b323cdcecd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:42.108325 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23d240-65db-4e5c-a611-24b323cdcecd None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:42.122648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-7b23d240-65db-4e5c-a611-24b323cdcecd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:42.122648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:42.122648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:42.122648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:42.122648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:42.122648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:42.122648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:42.122648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:42.122648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:42.122648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:42.122648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:42.122648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:42.122648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:42.122648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:42.122648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:42.122648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:42.123774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:42.123774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:42.123774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:42.123774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:42.123774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:42.123774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:42.123774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:42.123774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:42.123774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:42.123774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:42.123774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:42.123774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:42.123774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:42.123774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:42.123774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:42.123774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:42.123774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:42.124827 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:42.124827 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:42.124827 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:16:42.124827 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 439/877] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:42.129394 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dc591-87b8-414c-913d-c07d205b2068 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:42.213289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:42.225093 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dc591-87b8-414c-913d-c07d205b2068 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:42.258123 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615860d-1efc-47c0-a5f8-e7c97745b732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:42.258701 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615860d-1efc-47c0-a5f8-e7c97745b732 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:42.258977 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615860d-1efc-47c0-a5f8-e7c97745b732 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:42.259275 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615860d-1efc-47c0-a5f8-e7c97745b732 None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:42.259903 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615860d-1efc-47c0-a5f8-e7c97745b732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:42.260201 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615860d-1efc-47c0-a5f8-e7c97745b732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:42.261578 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615860d-1efc-47c0-a5f8-e7c97745b732 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:42.272369 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 439/878] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:42.277970 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23d240-65db-4e5c-a611-24b323cdcecd None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:42.375709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23d240-65db-4e5c-a611-24b323cdcecd None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:42.407432 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa5ec2-87cb-4b98-aeb0-4d46222b73d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:42.408037 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa5ec2-87cb-4b98-aeb0-4d46222b73d7 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:42.408314 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa5ec2-87cb-4b98-aeb0-4d46222b73d7 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:42.408585 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa5ec2-87cb-4b98-aeb0-4d46222b73d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:42.415616 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa5ec2-87cb-4b98-aeb0-4d46222b73d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:42.417078 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa5ec2-87cb-4b98-aeb0-4d46222b73d7 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:42.427985 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-42aa5ec2-87cb-4b98-aeb0-4d46222b73d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:42.427985 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:42.427985 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:42.427985 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:42.427985 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:42.427985 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:42.427985 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:42.427985 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:42.427985 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:42.427985 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:42.427985 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:42.427985 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:42.427985 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:16:42.427985 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:16:42.427985 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:16:42.429597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:16:42.429597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:42.429597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:42.429597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:42.429597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:42.429597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:42.429597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:42.429597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:42.429597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:42.429597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:42.429597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:42.429597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:42.429597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:42.429597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:42.429597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:42.429597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:42.429597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:42.430490 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:16:42.430490 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:16:42.430490 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:16:42.430490 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:16:42.430490 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:16:42.430490 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:16:42.430490 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:42.430490 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:16:42.430490 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 440/879] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:42.435849 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615860d-1efc-47c0-a5f8-e7c97745b732 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:42.534067 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615860d-1efc-47c0-a5f8-e7c97745b732 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:42.567501 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06392ec-eaf9-4b91-8326-f19555fe3eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:42.568093 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06392ec-eaf9-4b91-8326-f19555fe3eb5 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:42.568372 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06392ec-eaf9-4b91-8326-f19555fe3eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:42.568644 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06392ec-eaf9-4b91-8326-f19555fe3eb5 None admin] PATH_INFO: `/v3/projects` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:42.569330 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06392ec-eaf9-4b91-8326-f19555fe3eb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:42.569636 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06392ec-eaf9-4b91-8326-f19555fe3eb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:42.571165 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06392ec-eaf9-4b91-8326-f19555fe3eb5 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:42.582721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 440/880] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:16:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:42.589280 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa5ec2-87cb-4b98-aeb0-4d46222b73d7 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:42.611360 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:42.693253 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa5ec2-87cb-4b98-aeb0-4d46222b73d7 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:42.726783 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f5683-bef4-4366-9b01-23313e5626da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:42.727392 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5683-bef4-4366-9b01-23313e5626da None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:42.727669 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5683-bef4-4366-9b01-23313e5626da None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:42.727939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5683-bef4-4366-9b01-23313e5626da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:42.728656 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f5683-bef4-4366-9b01-23313e5626da None admin] RBAC: Adding query filter params (role.id=9b372d4fe82a4a54a3ecd29e7b912586, scope.project.id=a63a68d37106431e80bd876cdce3e5fa, user.id=ebffbdf5a1234167903a9fd4490bb174) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:42.728961 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f5683-bef4-4366-9b01-23313e5626da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:42.730379 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f5683-bef4-4366-9b01-23313e5626da None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:42.735544 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 441/881] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:16:42 2022] GET /identity/v3/role_assignments?user.id=ebffbdf5a1234167903a9fd4490bb174&scope.project.id=a63a68d37106431e80bd876cdce3e5fa&role.id=9b372d4fe82a4a54a3ecd29e7b912586 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:44.885879 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e13f4a-2f40-4614-95f0-9d681296929a None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:44.886379 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e13f4a-2f40-4614-95f0-9d681296929a None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:44.886379 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e13f4a-2f40-4614-95f0-9d681296929a None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:44.887732 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 441/882] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:44.893065 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6cf48-78e0-4874-8a49-2c8ddd6e810f None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:44.893478 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6cf48-78e0-4874-8a49-2c8ddd6e810f None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:44.893610 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6cf48-78e0-4874-8a49-2c8ddd6e810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:44.911620 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-1ce6cf48-78e0-4874-8a49-2c8ddd6e810f None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:44.912793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-1ce6cf48-78e0-4874-8a49-2c8ddd6e810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:44.978088 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 442/883] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:44 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:45.299624 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e13f4a-2f40-4614-95f0-9d681296929a None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:45.312029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:45.401473 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e13f4a-2f40-4614-95f0-9d681296929a None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:45.435351 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82533b-5eee-4d8a-a96a-04cf4a482831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:45.435956 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82533b-5eee-4d8a-a96a-04cf4a482831 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:45.436235 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82533b-5eee-4d8a-a96a-04cf4a482831 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:45.436508 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82533b-5eee-4d8a-a96a-04cf4a482831 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:45.446444 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82533b-5eee-4d8a-a96a-04cf4a482831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:16:45.451091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-fa82533b-5eee-4d8a-a96a-04cf4a482831 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:16:45.451091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:45.451091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:45.451091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:45.451091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:45.451091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:45.451091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:45.451091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:45.451091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:45.451091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:45.451091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:45.451091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:45.451091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:16:45.451091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:16:45.451091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:16:45.451091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:16:45.452177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:16:45.452177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:16:45.452177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:16:45.452177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:16:45.452177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:45.452177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:45.452177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:45.452177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:45.452177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:45.452177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:45.452177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:45.452177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:45.452177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:45.452177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:45.452177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:45.452177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:45.453047 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:45.453047 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:45.453047 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:45.453047 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:45.453047 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:16:45.453047 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:16:45.453047 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:16:45.453047 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:16:45.453047 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:16:45.453047 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:16:45.453047 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:16:45.453047 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:16:45.453047 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 442/884] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 00:16:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:45.458169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6cf48-78e0-4874-8a49-2c8ddd6e810f None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:45.473461 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:45.556690 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6cf48-78e0-4874-8a49-2c8ddd6e810f None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:45.589788 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62db881-ff7c-492f-9661-a7c7ed8ac6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:45.590377 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62db881-ff7c-492f-9661-a7c7ed8ac6b7 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:45.590649 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62db881-ff7c-492f-9661-a7c7ed8ac6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:45.590922 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62db881-ff7c-492f-9661-a7c7ed8ac6b7 None admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:45.591614 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62db881-ff7c-492f-9661-a7c7ed8ac6b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:45.591918 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62db881-ff7c-492f-9661-a7c7ed8ac6b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:45.593282 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62db881-ff7c-492f-9661-a7c7ed8ac6b7 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:45.601521 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 443/885] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:16:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:45.607439 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82533b-5eee-4d8a-a96a-04cf4a482831 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:45.676556 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:45.711106 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82533b-5eee-4d8a-a96a-04cf4a482831 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:45.745289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b7686-2476-4e04-8e7c-0f6e439737a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:45.745892 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b7686-2476-4e04-8e7c-0f6e439737a8 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:45.746309 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b7686-2476-4e04-8e7c-0f6e439737a8 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:45.746580 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b7686-2476-4e04-8e7c-0f6e439737a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:45.756283 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b7686-2476-4e04-8e7c-0f6e439737a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:45.757735 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b7686-2476-4e04-8e7c-0f6e439737a8 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:45.771518 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-741b7686-2476-4e04-8e7c-0f6e439737a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:45.771518 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:45.771518 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:45.771518 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:45.771518 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:45.771518 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:45.771518 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:45.771518 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:45.771518 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:45.771518 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:45.771518 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:45.771518 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:45.771518 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:45.771518 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:45.771518 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:45.771518 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:45.773111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:45.773111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:45.773111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:45.773111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:45.773111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:45.773111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:45.773111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:45.773111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:45.773111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:45.773111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:45.773111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:45.773111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:45.773111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:45.773111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:45.773111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:45.773111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:45.773111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:45.774386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:45.774386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:45.774386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:16:45.774386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 443/886] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:45.779150 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62db881-ff7c-492f-9661-a7c7ed8ac6b7 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:45.855011 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:45.877287 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62db881-ff7c-492f-9661-a7c7ed8ac6b7 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:45.909924 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a97b59-100e-4a52-8c78-1a98546c3583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:45.910526 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a97b59-100e-4a52-8c78-1a98546c3583 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:45.910766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a97b59-100e-4a52-8c78-1a98546c3583 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:45.911057 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a97b59-100e-4a52-8c78-1a98546c3583 None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:45.911686 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a97b59-100e-4a52-8c78-1a98546c3583 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:45.911987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a97b59-100e-4a52-8c78-1a98546c3583 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:45.913387 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a97b59-100e-4a52-8c78-1a98546c3583 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:45.924534 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 444/887] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:45.930626 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b7686-2476-4e04-8e7c-0f6e439737a8 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:46.030985 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b7686-2476-4e04-8e7c-0f6e439737a8 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:46.060222 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:46.075251 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4faf61-474b-4372-9d9a-70c9a6a06af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:46.075885 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4faf61-474b-4372-9d9a-70c9a6a06af6 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:46.076170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4faf61-474b-4372-9d9a-70c9a6a06af6 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:46.076441 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4faf61-474b-4372-9d9a-70c9a6a06af6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:46.084080 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4faf61-474b-4372-9d9a-70c9a6a06af6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:46.086111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4faf61-474b-4372-9d9a-70c9a6a06af6 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:46.097097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-ee4faf61-474b-4372-9d9a-70c9a6a06af6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:16:46.097097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:46.097097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:46.097097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:46.097097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:46.097097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:46.097097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:46.097097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:46.097097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:46.097097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:46.097097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:46.097097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:46.097097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:16:46.097097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:16:46.097097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:16:46.097097 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:16:46.098247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:46.098247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:46.098247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:16:46.098247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:46.098247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:16:46.098247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:46.098247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:46.098247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:46.098247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:46.098247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:46.098247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:46.098247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:46.098247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:46.098247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:46.098247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:46.098247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:46.098247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:46.098247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:46.099308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:46.099308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:46.099308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:16:46.099308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:16:46.099308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:16:46.099308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:16:46.099308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:16:46.099308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:16:46.099308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:16:46.099308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:16:46.099308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 444/888] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:46.104240 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a97b59-100e-4a52-8c78-1a98546c3583 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:46.202391 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a97b59-100e-4a52-8c78-1a98546c3583 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:46.235254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13d21a-8313-403b-9a4b-4b3a46b53a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:46.235856 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13d21a-8313-403b-9a4b-4b3a46b53a53 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:46.236134 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13d21a-8313-403b-9a4b-4b3a46b53a53 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:46.236405 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13d21a-8313-403b-9a4b-4b3a46b53a53 None admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:46.237132 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13d21a-8313-403b-9a4b-4b3a46b53a53 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:46.237441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13d21a-8313-403b-9a4b-4b3a46b53a53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:46.238884 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13d21a-8313-403b-9a4b-4b3a46b53a53 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:46.242271 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:46.258296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 445/889] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 24 00:16:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:46.264101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4faf61-474b-4372-9d9a-70c9a6a06af6 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:46.371119 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4faf61-474b-4372-9d9a-70c9a6a06af6 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:46.404420 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0004514-4b51-430d-83b3-ea1ce4e2ef7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:46.405058 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0004514-4b51-430d-83b3-ea1ce4e2ef7e None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:46.405319 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0004514-4b51-430d-83b3-ea1ce4e2ef7e None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:46.405592 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0004514-4b51-430d-83b3-ea1ce4e2ef7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:46.416286 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0004514-4b51-430d-83b3-ea1ce4e2ef7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:46.417743 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0004514-4b51-430d-83b3-ea1ce4e2ef7e None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:46.431968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-a0004514-4b51-430d-83b3-ea1ce4e2ef7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:46.431968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:46.431968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:46.431968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:46.431968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:46.431968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:46.431968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:46.431968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:46.431968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:46.431968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:46.431968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:46.431968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:46.431968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:46.431968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:46.431968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:46.431968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:46.433375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:46.433375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:46.433375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:46.433375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:46.433375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:46.433375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:46.433375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:46.433375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:46.433375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:46.433375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:46.433375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:46.433375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:46.433375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:46.433375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:46.433375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:46.433375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:46.433375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:46.434692 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:46.434692 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:46.434692 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:16:46.434692 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 445/890] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:46.439114 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13d21a-8313-403b-9a4b-4b3a46b53a53 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:46.544997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13d21a-8313-403b-9a4b-4b3a46b53a53 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:46.580831 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815141f0-18be-4e6c-b295-a47c1acafb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:46.581424 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815141f0-18be-4e6c-b295-a47c1acafb8b None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:46.581704 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815141f0-18be-4e6c-b295-a47c1acafb8b None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:46.581973 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815141f0-18be-4e6c-b295-a47c1acafb8b None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:46.582610 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815141f0-18be-4e6c-b295-a47c1acafb8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:46.582902 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815141f0-18be-4e6c-b295-a47c1acafb8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:46.584300 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815141f0-18be-4e6c-b295-a47c1acafb8b None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:46.596085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 446/891] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:46.601869 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0004514-4b51-430d-83b3-ea1ce4e2ef7e None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:46.634112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:46.714692 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0004514-4b51-430d-83b3-ea1ce4e2ef7e None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:46.747649 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c42e2-ec1e-4189-95b2-2625ba604e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:46.748259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c42e2-ec1e-4189-95b2-2625ba604e6f None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:46.748534 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c42e2-ec1e-4189-95b2-2625ba604e6f None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:46.748803 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c42e2-ec1e-4189-95b2-2625ba604e6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:46.755657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c42e2-ec1e-4189-95b2-2625ba604e6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:46.757609 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c42e2-ec1e-4189-95b2-2625ba604e6f None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:46.769076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-c21c42e2-ec1e-4189-95b2-2625ba604e6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:46.769076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:46.769076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:46.769076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:46.769076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:46.769076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:46.769076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:46.769076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:46.769076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:46.769076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:46.769076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:46.769076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:46.769076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:16:46.769076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:16:46.769076 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:16:46.770157 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:16:46.770157 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:46.770157 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:46.770157 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:46.770157 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:46.770157 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:46.770157 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:46.770157 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:46.770157 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:46.770157 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:46.770157 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:46.770157 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:46.770157 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:46.770157 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:46.770157 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:46.770157 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:46.770157 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:46.771303 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:16:46.771303 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:16:46.771303 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:16:46.771303 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:16:46.771303 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:16:46.771303 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:16:46.771303 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:46.771303 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:16:46.771303 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 446/892] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:46.776678 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815141f0-18be-4e6c-b295-a47c1acafb8b None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:46.839505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:46.889633 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815141f0-18be-4e6c-b295-a47c1acafb8b None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:46.923008 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a6803-b1cd-4a1c-8963-a08423640462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:46.923647 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a6803-b1cd-4a1c-8963-a08423640462 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:46.923873 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a6803-b1cd-4a1c-8963-a08423640462 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:46.924140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a6803-b1cd-4a1c-8963-a08423640462 None admin] PATH_INFO: `/v3/projects` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:46.924817 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a6803-b1cd-4a1c-8963-a08423640462 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:46.925119 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a6803-b1cd-4a1c-8963-a08423640462 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:46.926540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a6803-b1cd-4a1c-8963-a08423640462 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:46.939256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 447/893] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:16:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:46.945892 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c42e2-ec1e-4189-95b2-2625ba604e6f None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:47.048959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:47.060303 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c42e2-ec1e-4189-95b2-2625ba604e6f None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:47.095330 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f7dfc-7796-4cf6-8798-b3cef9af3815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:47.095990 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f7dfc-7796-4cf6-8798-b3cef9af3815 None admin] REQUEST_METHOD: `PUT` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:47.096269 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f7dfc-7796-4cf6-8798-b3cef9af3815 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:47.096544 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f7dfc-7796-4cf6-8798-b3cef9af3815 None admin] PATH_INFO: `/v3/projects/a63a68d37106431e80bd876cdce3e5fa/users/ebffbdf5a1234167903a9fd4490bb174/roles/9b372d4fe82a4a54a3ecd29e7b912586` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:47.098476 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f7dfc-7796-4cf6-8798-b3cef9af3815 None admin] RBAC: Authorizing `identity:create_grant(project_id=a63a68d37106431e80bd876cdce3e5fa, user_id=ebffbdf5a1234167903a9fd4490bb174, role_id=9b372d4fe82a4a54a3ecd29e7b912586)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:47.099974 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f7dfc-7796-4cf6-8798-b3cef9af3815 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:47.113545 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 447/894] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 00:16:46 2022] PUT /identity/v3/projects/a63a68d37106431e80bd876cdce3e5fa/users/ebffbdf5a1234167903a9fd4490bb174/roles/9b372d4fe82a4a54a3ecd29e7b912586 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 00:16:49.279857 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf1408-4374-4c65-aac4-c7b7c0800bc6 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:49.280411 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf1408-4374-4c65-aac4-c7b7c0800bc6 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:49.280411 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf1408-4374-4c65-aac4-c7b7c0800bc6 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:49.281710 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 448/895] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:49.286808 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2eab39-03e9-4a36-bccd-a8b6f7aeec74 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:49.287256 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2eab39-03e9-4a36-bccd-a8b6f7aeec74 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:49.287374 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2eab39-03e9-4a36-bccd-a8b6f7aeec74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:49.305363 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-0b2eab39-03e9-4a36-bccd-a8b6f7aeec74 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:49.306558 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-0b2eab39-03e9-4a36-bccd-a8b6f7aeec74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:49.371826 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 448/896] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:49 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:49.699926 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf1408-4374-4c65-aac4-c7b7c0800bc6 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:49.798533 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf1408-4374-4c65-aac4-c7b7c0800bc6 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:49.813442 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:49.833018 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354b930-7b26-4deb-8a2d-44d60286f8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:49.833633 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354b930-7b26-4deb-8a2d-44d60286f8b6 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:49.833912 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354b930-7b26-4deb-8a2d-44d60286f8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:49.834189 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354b930-7b26-4deb-8a2d-44d60286f8b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:49.844174 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354b930-7b26-4deb-8a2d-44d60286f8b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 00:16:49.848836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-7354b930-7b26-4deb-8a2d-44d60286f8b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:16:49.848836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:49.848836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:49.848836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:49.848836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:49.848836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:49.848836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:49.848836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:49.848836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:49.848836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:49.848836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:49.848836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:49.848836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 00:16:49.848836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 00:16:49.848836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 00:16:49.848836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 00:16:49.849909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 00:16:49.849909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 00:16:49.849909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 00:16:49.849909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 00:16:49.849909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:49.849909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:49.849909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:49.849909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:49.849909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:49.849909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:49.849909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:49.849909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:49.849909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:49.849909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:49.849909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:49.849909 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:49.852187 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:49.852187 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:49.852187 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:49.852187 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:49.852187 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 00:16:49.852187 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 00:16:49.852187 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 00:16:49.852187 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 00:16:49.852187 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 00:16:49.852187 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 00:16:49.852187 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 00:16:49.852187 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:16:49.852187 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 449/897] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 00:16:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:49.856452 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2eab39-03e9-4a36-bccd-a8b6f7aeec74 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:49.934506 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:49.952503 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2eab39-03e9-4a36-bccd-a8b6f7aeec74 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:49.985585 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240b7d3-b765-4bd4-a41a-2bcee3259397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:49.986170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240b7d3-b765-4bd4-a41a-2bcee3259397 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:49.986443 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240b7d3-b765-4bd4-a41a-2bcee3259397 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:49.986710 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240b7d3-b765-4bd4-a41a-2bcee3259397 None admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:49.987399 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240b7d3-b765-4bd4-a41a-2bcee3259397 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:49.987700 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240b7d3-b765-4bd4-a41a-2bcee3259397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:49.989064 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240b7d3-b765-4bd4-a41a-2bcee3259397 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:49.996755 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 449/898] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 00:16:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:50.002570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354b930-7b26-4deb-8a2d-44d60286f8b6 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:50.123730 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354b930-7b26-4deb-8a2d-44d60286f8b6 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:50.156256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9108b5-0550-42f4-a1fc-74dd99400b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:50.156861 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9108b5-0550-42f4-a1fc-74dd99400b5c None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:50.157139 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9108b5-0550-42f4-a1fc-74dd99400b5c None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:50.157411 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9108b5-0550-42f4-a1fc-74dd99400b5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:50.168095 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9108b5-0550-42f4-a1fc-74dd99400b5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:50.169532 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9108b5-0550-42f4-a1fc-74dd99400b5c None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:50.183322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-aa9108b5-0550-42f4-a1fc-74dd99400b5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:50.183322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:50.183322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:50.183322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:50.183322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:50.183322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:50.183322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:50.183322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:50.183322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:50.183322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:50.183322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:50.183322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:50.183322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:50.183322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:50.183322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:50.183322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:50.184313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:50.184313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:50.184313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:50.184313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:50.184313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:50.184313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:50.184313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:50.184313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:50.184313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:50.184313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:50.184313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:50.184313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:50.184313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:50.184313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:50.184313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:50.184313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:50.184313 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:50.185200 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:50.185200 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:50.185200 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:16:50.185200 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 450/899] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:50.190284 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240b7d3-b765-4bd4-a41a-2bcee3259397 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:50.286343 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240b7d3-b765-4bd4-a41a-2bcee3259397 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:50.318849 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b664f0d-9e67-463b-a72e-4aee4982614d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:50.319981 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b664f0d-9e67-463b-a72e-4aee4982614d None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:50.320247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b664f0d-9e67-463b-a72e-4aee4982614d None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:50.320515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b664f0d-9e67-463b-a72e-4aee4982614d None admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:50.321137 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b664f0d-9e67-463b-a72e-4aee4982614d None admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:50.321436 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b664f0d-9e67-463b-a72e-4aee4982614d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:50.322798 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b664f0d-9e67-463b-a72e-4aee4982614d None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:50.334065 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 450/900] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:50.340262 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9108b5-0550-42f4-a1fc-74dd99400b5c None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:50.367876 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:50.438712 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9108b5-0550-42f4-a1fc-74dd99400b5c None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:50.472335 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a1de9-3382-4b7f-bbd7-56a41a1e015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:50.472949 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a1de9-3382-4b7f-bbd7-56a41a1e015e None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:50.473298 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a1de9-3382-4b7f-bbd7-56a41a1e015e None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:50.473607 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a1de9-3382-4b7f-bbd7-56a41a1e015e None admin] PATH_INFO: `/v3/users/placement` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:50.481305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a1de9-3382-4b7f-bbd7-56a41a1e015e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:50.482742 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a1de9-3382-4b7f-bbd7-56a41a1e015e None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:50.493987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-527a1de9-3382-4b7f-bbd7-56a41a1e015e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:16:50.493987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:50.493987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:50.493987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:50.493987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:50.493987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:50.493987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:50.493987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:50.493987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:50.493987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:50.493987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:50.493987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:50.493987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 00:16:50.493987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 00:16:50.493987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 00:16:50.493987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 00:16:50.495063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:50.495063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:50.495063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 00:16:50.495063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:50.495063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 00:16:50.495063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 00:16:50.495063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:50.495063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:50.495063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:50.495063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:50.495063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:50.495063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:50.495063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:50.495063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:50.495063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:50.495063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:50.495063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:50.495063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:50.496018 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:50.496018 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:50.496018 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 00:16:50.496018 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 00:16:50.496018 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 00:16:50.496018 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 00:16:50.496018 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 00:16:50.496018 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 00:16:50.496018 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 00:16:50.496018 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:16:50.496018 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 451/901] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:50.501023 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b664f0d-9e67-463b-a72e-4aee4982614d None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:50.504788 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:50.602752 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b664f0d-9e67-463b-a72e-4aee4982614d None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:50.635545 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72ef88-60b8-46ea-a4fb-4e71bf7cec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:50.636173 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72ef88-60b8-46ea-a4fb-4e71bf7cec84 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:50.636452 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72ef88-60b8-46ea-a4fb-4e71bf7cec84 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:50.636723 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72ef88-60b8-46ea-a4fb-4e71bf7cec84 None admin] PATH_INFO: `/v3/users` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:50.637443 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72ef88-60b8-46ea-a4fb-4e71bf7cec84 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:50.637750 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72ef88-60b8-46ea-a4fb-4e71bf7cec84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:50.639205 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72ef88-60b8-46ea-a4fb-4e71bf7cec84 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:50.656242 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 451/902] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 24 00:16:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:50.662204 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a1de9-3382-4b7f-bbd7-56a41a1e015e None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:50.748274 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:50.763514 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a1de9-3382-4b7f-bbd7-56a41a1e015e None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:50.795302 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4e6e2-1e8c-44a7-a28e-c7df43f0c8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:50.795887 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4e6e2-1e8c-44a7-a28e-c7df43f0c8c7 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:50.796160 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4e6e2-1e8c-44a7-a28e-c7df43f0c8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:50.796426 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4e6e2-1e8c-44a7-a28e-c7df43f0c8c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:50.861441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4e6e2-1e8c-44a7-a28e-c7df43f0c8c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:50.862805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4e6e2-1e8c-44a7-a28e-c7df43f0c8c7 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:50.943302 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:50.959162 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 452/903] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 00:16:50 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 00:16:50.964897 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72ef88-60b8-46ea-a4fb-4e71bf7cec84 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:51.025561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:51.072730 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72ef88-60b8-46ea-a4fb-4e71bf7cec84 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:51.107239 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32621a-00e0-47e3-ba67-ce92915d6790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:51.107851 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32621a-00e0-47e3-ba67-ce92915d6790 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:51.108122 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32621a-00e0-47e3-ba67-ce92915d6790 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:51.108387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32621a-00e0-47e3-ba67-ce92915d6790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:51.118558 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32621a-00e0-47e3-ba67-ce92915d6790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:51.119970 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32621a-00e0-47e3-ba67-ce92915d6790 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:51.133762 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-0a32621a-00e0-47e3-ba67-ce92915d6790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:51.133762 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:51.133762 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:51.133762 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:51.133762 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:51.133762 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:51.133762 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:51.133762 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:51.133762 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:51.133762 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:51.133762 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:51.133762 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:51.133762 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 00:16:51.133762 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 00:16:51.133762 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 00:16:51.133762 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 00:16:51.134846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:51.134846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:51.134846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:51.134846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:51.134846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:51.134846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:51.134846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:51.134846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:51.134846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:51.134846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:51.134846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:51.134846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:51.134846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:51.134846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:51.134846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:51.134846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:51.134846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 00:16:51.135798 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 00:16:51.135798 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 00:16:51.135798 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:16:51.135798 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 452/904] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:51.140644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4e6e2-1e8c-44a7-a28e-c7df43f0c8c7 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:51.239457 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4e6e2-1e8c-44a7-a28e-c7df43f0c8c7 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:51.273076 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1517f7-0b58-4b86-b9ff-6a26c5d56dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:51.273665 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1517f7-0b58-4b86-b9ff-6a26c5d56dc1 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:51.273944 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1517f7-0b58-4b86-b9ff-6a26c5d56dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:51.274217 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1517f7-0b58-4b86-b9ff-6a26c5d56dc1 None admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:51.274855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1517f7-0b58-4b86-b9ff-6a26c5d56dc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:51.275187 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1517f7-0b58-4b86-b9ff-6a26c5d56dc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:51.276559 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1517f7-0b58-4b86-b9ff-6a26c5d56dc1 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:51.288511 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 453/905] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 00:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:51.294181 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32621a-00e0-47e3-ba67-ce92915d6790 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:51.395718 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32621a-00e0-47e3-ba67-ce92915d6790 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:51.408857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:51.429499 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e73099-1245-4967-8a12-5ad9d9dcbae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:51.430124 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e73099-1245-4967-8a12-5ad9d9dcbae4 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:51.430402 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e73099-1245-4967-8a12-5ad9d9dcbae4 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:51.430672 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e73099-1245-4967-8a12-5ad9d9dcbae4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:51.437359 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e73099-1245-4967-8a12-5ad9d9dcbae4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:51.438808 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e73099-1245-4967-8a12-5ad9d9dcbae4 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:51.449751 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application [None req-e2e73099-1245-4967-8a12-5ad9d9dcbae4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:51.449751 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:51.449751 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:51.449751 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:51.449751 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:51.449751 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:51.449751 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:51.449751 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:51.449751 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:51.449751 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:51.449751 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:51.449751 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:51.449751 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 00:16:51.449751 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 00:16:51.449751 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 00:16:51.450772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 00:16:51.450772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:51.450772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:51.450772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:51.450772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:51.450772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:51.450772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:51.450772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:51.450772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:51.450772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:51.450772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:51.450772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:51.450772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:51.450772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:51.450772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:51.450772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:51.450772 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:51.451930 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 00:16:51.451930 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 00:16:51.451930 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 00:16:51.451930 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 00:16:51.451930 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 00:16:51.451930 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 00:16:51.451930 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 00:16:51.451930 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: ERROR keystone.server.flask.application Aug 24 00:16:51.451930 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 453/906] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 00:16:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:51.456729 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1517f7-0b58-4b86-b9ff-6a26c5d56dc1 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:51.503381 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:51.562980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1517f7-0b58-4b86-b9ff-6a26c5d56dc1 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:51.595836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53adc9-34db-4803-9f09-dc0b539bfaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:51.596428 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53adc9-34db-4803-9f09-dc0b539bfaed None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:51.596710 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53adc9-34db-4803-9f09-dc0b539bfaed None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:51.596981 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53adc9-34db-4803-9f09-dc0b539bfaed None admin] PATH_INFO: `/v3/projects` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:51.597669 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53adc9-34db-4803-9f09-dc0b539bfaed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:51.597976 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53adc9-34db-4803-9f09-dc0b539bfaed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:51.599440 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53adc9-34db-4803-9f09-dc0b539bfaed None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:51.611833 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 454/907] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 00:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:51.617920 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e73099-1245-4967-8a12-5ad9d9dcbae4 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:51.715456 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e73099-1245-4967-8a12-5ad9d9dcbae4 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:51.749091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914b464-8504-4a9b-b3ed-e64ba9c7d321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:51.749681 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914b464-8504-4a9b-b3ed-e64ba9c7d321 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:51.749963 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914b464-8504-4a9b-b3ed-e64ba9c7d321 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:51.750240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914b464-8504-4a9b-b3ed-e64ba9c7d321 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:51.750963 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914b464-8504-4a9b-b3ed-e64ba9c7d321 None admin] RBAC: Adding query filter params (role.id=9b372d4fe82a4a54a3ecd29e7b912586, scope.project.id=a63a68d37106431e80bd876cdce3e5fa, user.id=ebffbdf5a1234167903a9fd4490bb174) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:51.751310 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914b464-8504-4a9b-b3ed-e64ba9c7d321 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:51.752750 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914b464-8504-4a9b-b3ed-e64ba9c7d321 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:51.758375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 454/908] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 00:16:51 2022] GET /identity/v3/role_assignments?user.id=ebffbdf5a1234167903a9fd4490bb174&scope.project.id=a63a68d37106431e80bd876cdce3e5fa&role.id=9b372d4fe82a4a54a3ecd29e7b912586 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:53.958724 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5389b-06cc-4f21-8497-11f695e9e898 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:53.959372 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5389b-06cc-4f21-8497-11f695e9e898 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:53.959372 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5389b-06cc-4f21-8497-11f695e9e898 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:53.960525 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 455/909] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:53.965851 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771d35f-9d29-4785-b427-87825343d067 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:53.966297 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771d35f-9d29-4785-b427-87825343d067 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:53.966389 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771d35f-9d29-4785-b427-87825343d067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:53.984510 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-c771d35f-9d29-4785-b427-87825343d067 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:53.985708 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-c771d35f-9d29-4785-b427-87825343d067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:54.016002 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:54.063057 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 455/910] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:53 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:16:54.400200 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5389b-06cc-4f21-8497-11f695e9e898 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:54.509581 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5389b-06cc-4f21-8497-11f695e9e898 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:54.517807 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:54.549073 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea75665-37b7-47cd-bea9-b9794f94744c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:54.549694 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea75665-37b7-47cd-bea9-b9794f94744c None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:54.549971 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea75665-37b7-47cd-bea9-b9794f94744c None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:54.550240 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea75665-37b7-47cd-bea9-b9794f94744c None admin] PATH_INFO: `/v3/services/placement` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:54.550819 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea75665-37b7-47cd-bea9-b9794f94744c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:54.552232 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea75665-37b7-47cd-bea9-b9794f94744c None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:54.561044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-cea75665-37b7-47cd-bea9-b9794f94744c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 00:16:54.561044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:54.561044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:16:54.561044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:16:54.561044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:16:54.561044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:16:54.561044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:16:54.561044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:54.561044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 00:16:54.561044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:16:54.561044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:16:54.561044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:16:54.561044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:16:54.561044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:16:54.561044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:16:54.561044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:16:54.561044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:16:54.563492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:16:54.563492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:16:54.563492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:16:54.563492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:16:54.563492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:16:54.563492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:16:54.563492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:16:54.563492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:16:54.563492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:16:54.563492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:16:54.563492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:16:54.563492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:16:54.563492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:16:54.563492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:16:54.563492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:16:54.563492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:16:54.564595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:16:54.564595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:16:54.564595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:16:54.564595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:16:54.564595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:16:54.564595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:16:54.564595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:16:54.564595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:16:54.564595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:16:54.564595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:16:54.564595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:16:54.564595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:16:54.564595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 00:16:54.564595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:16:54.564595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 456/911] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 24 00:16:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:16:54.568105 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771d35f-9d29-4785-b427-87825343d067 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:54.666285 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771d35f-9d29-4785-b427-87825343d067 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:54.699956 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbd131-bf09-446a-86c6-5698b0aa8032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:54.700552 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbd131-bf09-446a-86c6-5698b0aa8032 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:54.700831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbd131-bf09-446a-86c6-5698b0aa8032 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:54.701103 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbd131-bf09-446a-86c6-5698b0aa8032 None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:54.701726 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbd131-bf09-446a-86c6-5698b0aa8032 None admin] RBAC: Adding query filter params (name=placement) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:54.702029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbd131-bf09-446a-86c6-5698b0aa8032 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:54.703735 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbd131-bf09-446a-86c6-5698b0aa8032 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:54.708757 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 456/912] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Aug 24 00:16:54 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:54.715031 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea75665-37b7-47cd-bea9-b9794f94744c None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:54.822135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea75665-37b7-47cd-bea9-b9794f94744c None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:54.854481 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83951efb-ed6a-48a0-ba7f-b8cedff28457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:54.855092 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83951efb-ed6a-48a0-ba7f-b8cedff28457 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:54.855373 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83951efb-ed6a-48a0-ba7f-b8cedff28457 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:54.855643 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83951efb-ed6a-48a0-ba7f-b8cedff28457 None admin] PATH_INFO: `/v3/services` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:54.856267 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83951efb-ed6a-48a0-ba7f-b8cedff28457 None admin] RBAC: Adding query filter params (type=placement) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:16:54.856567 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83951efb-ed6a-48a0-ba7f-b8cedff28457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:54.857930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83951efb-ed6a-48a0-ba7f-b8cedff28457 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:54.862132 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 457/913] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Aug 24 00:16:54 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:16:57.017739 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202234c6-af4f-4761-b61a-835bef717ea1 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:57.018244 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202234c6-af4f-4761-b61a-835bef717ea1 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:57.018351 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202234c6-af4f-4761-b61a-835bef717ea1 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:57.019758 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 457/914] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:16:57.025380 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324ad19-a632-4efa-a12c-527339da57e2 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:57.026055 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324ad19-a632-4efa-a12c-527339da57e2 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:57.026055 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324ad19-a632-4efa-a12c-527339da57e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:57.045921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-2324ad19-a632-4efa-a12c-527339da57e2 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:57.047317 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-2324ad19-a632-4efa-a12c-527339da57e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:57.077763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:57.125144 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 458/915] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:57 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 00:16:57.455218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202234c6-af4f-4761-b61a-835bef717ea1 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:16:57.489292 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:16:57.563119 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202234c6-af4f-4761-b61a-835bef717ea1 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:16:57.597265 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f87b9-cfbb-4adc-ad25-70640c5f1e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:16:57.597856 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f87b9-cfbb-4adc-ad25-70640c5f1e68 None admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:57.598135 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f87b9-cfbb-4adc-ad25-70640c5f1e68 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:57.598406 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f87b9-cfbb-4adc-ad25-70640c5f1e68 None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:57.599071 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f87b9-cfbb-4adc-ad25-70640c5f1e68 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:16:57.601011 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f87b9-cfbb-4adc-ad25-70640c5f1e68 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:16:57.617712 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 458/916] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 00:16:57 2022] POST /identity/v3/services => generated 246 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:16:59.782391 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874d561-eeb7-4c50-8fd9-4935c9e53257 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:59.782893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874d561-eeb7-4c50-8fd9-4935c9e53257 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:59.782893 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874d561-eeb7-4c50-8fd9-4935c9e53257 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:59.784521 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 459/917] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:16:59.789860 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b4641-c102-471b-8162-5de3ef42f46b None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:16:59.790270 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b4641-c102-471b-8162-5de3ef42f46b None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:16:59.790387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b4641-c102-471b-8162-5de3ef42f46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:16:59.810569 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-906b4641-c102-471b-8162-5de3ef42f46b None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:16:59.811811 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-906b4641-c102-471b-8162-5de3ef42f46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:16:59.883747 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 459/918] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:16:59 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:17:00.211446 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874d561-eeb7-4c50-8fd9-4935c9e53257 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:00.317125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874d561-eeb7-4c50-8fd9-4935c9e53257 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:00.352700 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ded7b4-bff0-4fc9-8fe0-2a7e49e4bf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:00.353322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ded7b4-bff0-4fc9-8fe0-2a7e49e4bf1e None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:00.353596 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ded7b4-bff0-4fc9-8fe0-2a7e49e4bf1e None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:00.353862 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ded7b4-bff0-4fc9-8fe0-2a7e49e4bf1e None admin] PATH_INFO: `/v3/services/placement` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:00.354439 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ded7b4-bff0-4fc9-8fe0-2a7e49e4bf1e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:00.355833 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ded7b4-bff0-4fc9-8fe0-2a7e49e4bf1e None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:00.364574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-d9ded7b4-bff0-4fc9-8fe0-2a7e49e4bf1e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 00:17:00.364574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:17:00.364574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:17:00.364574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:17:00.364574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:17:00.364574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:17:00.364574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:17:00.364574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:17:00.364574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 00:17:00.364574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:17:00.364574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:17:00.364574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:17:00.364574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:17:00.364574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:17:00.364574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:17:00.364574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:17:00.364574 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:17:00.365750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:17:00.365750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:17:00.365750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:17:00.365750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:17:00.365750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:17:00.365750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:17:00.365750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:17:00.365750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:17:00.365750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:17:00.365750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:17:00.365750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:17:00.365750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:17:00.365750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:17:00.365750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:17:00.365750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:17:00.365750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:17:00.366628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:17:00.366628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:17:00.366628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:17:00.366628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:17:00.366628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:17:00.366628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:17:00.366628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:17:00.366628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:17:00.366628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:17:00.366628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:17:00.366628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:17:00.366628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:17:00.366628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 00:17:00.366628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:17:00.366628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 460/919] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 24 00:17:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 00:17:00.372267 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b4641-c102-471b-8162-5de3ef42f46b None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:00.390555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:17:00.474662 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b4641-c102-471b-8162-5de3ef42f46b None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:00.509176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234ae55-2f74-44f5-a761-519a4823cb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:00.509775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234ae55-2f74-44f5-a761-519a4823cb44 None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:00.510059 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234ae55-2f74-44f5-a761-519a4823cb44 None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:00.510335 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234ae55-2f74-44f5-a761-519a4823cb44 None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:00.510962 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234ae55-2f74-44f5-a761-519a4823cb44 None admin] RBAC: Adding query filter params (name=placement) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:17:00.511317 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234ae55-2f74-44f5-a761-519a4823cb44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:00.512724 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234ae55-2f74-44f5-a761-519a4823cb44 None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:00.518232 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 460/920] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Aug 24 00:17:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:17:00.524459 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ded7b4-bff0-4fc9-8fe0-2a7e49e4bf1e None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:00.553329 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:17:00.623699 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ded7b4-bff0-4fc9-8fe0-2a7e49e4bf1e None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:00.655984 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a4cf4-5d58-4e13-8d6e-95550f08550b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:00.656568 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a4cf4-5d58-4e13-8d6e-95550f08550b None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:00.656840 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a4cf4-5d58-4e13-8d6e-95550f08550b None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:00.657105 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a4cf4-5d58-4e13-8d6e-95550f08550b None admin] PATH_INFO: `/v3/endpoints` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:00.657792 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a4cf4-5d58-4e13-8d6e-95550f08550b None admin] RBAC: Adding query filter params (interface=public, service_id=8cae7304b14b46f8b2d74a12c6328150, region_id=RegionOne) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:17:00.658095 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a4cf4-5d58-4e13-8d6e-95550f08550b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:00.659491 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a4cf4-5d58-4e13-8d6e-95550f08550b None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:00.665091 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 461/921] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 24 00:17:00 2022] GET /identity/v3/endpoints?service_id=8cae7304b14b46f8b2d74a12c6328150&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:17:00.670833 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234ae55-2f74-44f5-a761-519a4823cb44 None admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:00.751154 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:17:00.769162 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234ae55-2f74-44f5-a761-519a4823cb44 None admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:00.803756 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63d6b5-fc94-429a-a923-8ba903d5b98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:00.804374 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63d6b5-fc94-429a-a923-8ba903d5b98a None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:00.804621 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63d6b5-fc94-429a-a923-8ba903d5b98a None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:00.804897 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63d6b5-fc94-429a-a923-8ba903d5b98a None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:00.805501 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63d6b5-fc94-429a-a923-8ba903d5b98a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:00.807184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63d6b5-fc94-429a-a923-8ba903d5b98a None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:00.813650 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 461/922] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 24 00:17:00 2022] GET /identity/v3/services => generated 1962 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:17:02.993390 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917042c-fca7-4c67-b0ff-9c27d9289954 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:02.993912 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917042c-fca7-4c67-b0ff-9c27d9289954 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:02.993912 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917042c-fca7-4c67-b0ff-9c27d9289954 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:02.995277 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 462/923] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:17:03.000897 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e0075-6e00-4b8f-9f2f-f1d6398bb302 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:03.001370 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e0075-6e00-4b8f-9f2f-f1d6398bb302 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:03.001484 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e0075-6e00-4b8f-9f2f-f1d6398bb302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:03.021447 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-bb3e0075-6e00-4b8f-9f2f-f1d6398bb302 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:17:03.022645 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-bb3e0075-6e00-4b8f-9f2f-f1d6398bb302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:17:03.089880 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 462/924] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:17:02 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 00:17:03.426802 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917042c-fca7-4c67-b0ff-9c27d9289954 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:03.537183 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:17:03.549957 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917042c-fca7-4c67-b0ff-9c27d9289954 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:03.587051 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a50c6e-92f2-4203-909a-bd82ebd23b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:03.587664 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a50c6e-92f2-4203-909a-bd82ebd23b09 None admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:03.588318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a50c6e-92f2-4203-909a-bd82ebd23b09 None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:03.588318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a50c6e-92f2-4203-909a-bd82ebd23b09 None admin] PATH_INFO: `/v3/services/placement` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:03.588765 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a50c6e-92f2-4203-909a-bd82ebd23b09 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:03.590136 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a50c6e-92f2-4203-909a-bd82ebd23b09 None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:03.598794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application [None req-89a50c6e-92f2-4203-909a-bd82ebd23b09 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 00:17:03.598794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:17:03.598794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 00:17:03.598794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 00:17:03.598794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 00:17:03.598794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 00:17:03.598794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 00:17:03.598794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:17:03.598794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 00:17:03.598794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:17:03.598794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 00:17:03.598794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:17:03.598794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 00:17:03.598794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 00:17:03.598794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 00:17:03.598794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 00:17:03.598794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 00:17:03.600714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 00:17:03.600714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 00:17:03.600714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 00:17:03.600714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 00:17:03.600714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 00:17:03.600714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 00:17:03.600714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 00:17:03.600714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 00:17:03.600714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 00:17:03.600714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 00:17:03.600714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 00:17:03.600714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 00:17:03.600714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 00:17:03.600714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 00:17:03.600714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 00:17:03.600714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 00:17:03.602441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 00:17:03.602441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application with Lock( Aug 24 00:17:03.602441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 00:17:03.602441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self._enter() Aug 24 00:17:03.602441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 00:17:03.602441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 00:17:03.602441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 00:17:03.602441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application return self.creator() Aug 24 00:17:03.602441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 00:17:03.602441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application created_value = creator( Aug 24 00:17:03.602441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 00:17:03.602441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 00:17:03.602441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 00:17:03.602441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: ERROR keystone.server.flask.application Aug 24 00:17:03.602441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 463/925] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 24 00:17:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 00:17:03.612071 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e0075-6e00-4b8f-9f2f-f1d6398bb302 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:03.702400 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:17:03.725739 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e0075-6e00-4b8f-9f2f-f1d6398bb302 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:03.761159 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866def2-51f3-457a-9422-36420a31bbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:03.761888 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866def2-51f3-457a-9422-36420a31bbcb None admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:03.762175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866def2-51f3-457a-9422-36420a31bbcb None admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:03.762488 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866def2-51f3-457a-9422-36420a31bbcb None admin] PATH_INFO: `/v3/services` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:03.763234 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866def2-51f3-457a-9422-36420a31bbcb None admin] RBAC: Adding query filter params (name=placement) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:17:03.763572 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866def2-51f3-457a-9422-36420a31bbcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:03.765351 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866def2-51f3-457a-9422-36420a31bbcb None admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:03.773741 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 463/926] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Aug 24 00:17:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:17:03.780528 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a50c6e-92f2-4203-909a-bd82ebd23b09 None admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:17:03.884763 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a50c6e-92f2-4203-909a-bd82ebd23b09 None admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:17:03.917334 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df1ecb-25c7-4f9f-9621-7f7e2890b75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:17:03.917917 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df1ecb-25c7-4f9f-9621-7f7e2890b75f None admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:17:03.918193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df1ecb-25c7-4f9f-9621-7f7e2890b75f None admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:17:03.918463 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df1ecb-25c7-4f9f-9621-7f7e2890b75f None admin] PATH_INFO: `/v3/endpoints` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:17:03.919161 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df1ecb-25c7-4f9f-9621-7f7e2890b75f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:17:03.920516 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df1ecb-25c7-4f9f-9621-7f7e2890b75f None admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:17:03.941199 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 464/927] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 00:17:03 2022] POST /identity/v3/endpoints => generated 331 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:17:13.767847 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=30 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:17:13.937031 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:05.438542 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e96e4-83bc-4634-837f-588b97771683 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:05.439335 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e96e4-83bc-4634-837f-588b97771683 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:05.439335 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e96e4-83bc-4634-837f-588b97771683 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:05.444474 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 464/928] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:18:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:05.445838 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390499e9-acc2-4861-bc3b-5d18fbc5404e None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:05.446405 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390499e9-acc2-4861-bc3b-5d18fbc5404e None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:05.446405 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390499e9-acc2-4861-bc3b-5d18fbc5404e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:05.467209 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-390499e9-acc2-4861-bc3b-5d18fbc5404e None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:05.468482 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-390499e9-acc2-4861-bc3b-5d18fbc5404e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:05.567268 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 465/929] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:18:05.923237 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca95b0-4034-4c2c-b62b-3665dcbf2a8d None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:05.923517 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca95b0-4034-4c2c-b62b-3665dcbf2a8d None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:05.923787 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca95b0-4034-4c2c-b62b-3665dcbf2a8d None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:05.925981 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 465/930] 10.222.0.42 () {54 vars in 965 bytes} [Wed Aug 24 00:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:18:05.933066 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece6a6d-aa16-4447-bc18-dc2a71070cb0 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:05.933352 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece6a6d-aa16-4447-bc18-dc2a71070cb0 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:05.933629 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece6a6d-aa16-4447-bc18-dc2a71070cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:05.989936 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-dece6a6d-aa16-4447-bc18-dc2a71070cb0 None None] MFA Rules not processed for user `ad894f6b3613401c88cd3b39d825e61d`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:05.991206 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-dece6a6d-aa16-4447-bc18-dc2a71070cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:06.064396 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 466/931] 10.222.0.42 () {58 vars in 1062 bytes} [Wed Aug 24 00:18:05 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:18:06.073171 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca95b0-4034-4c2c-b62b-3665dcbf2a8d None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:06.084505 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca95b0-4034-4c2c-b62b-3665dcbf2a8d None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:06.088247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8e2f0-56da-48ba-99a2-fa1b5d41d26f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:06.088842 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8e2f0-56da-48ba-99a2-fa1b5d41d26f service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:06.089131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8e2f0-56da-48ba-99a2-fa1b5d41d26f service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:06.089406 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8e2f0-56da-48ba-99a2-fa1b5d41d26f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:06.099298 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8e2f0-56da-48ba-99a2-fa1b5d41d26f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:06.100733 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8e2f0-56da-48ba-99a2-fa1b5d41d26f service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:06.110657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 466/932] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:18:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:18:08.594125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8ae5-4e5d-444c-aff1-6f738b50532e None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:08.595022 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8ae5-4e5d-444c-aff1-6f738b50532e None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:08.595324 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8ae5-4e5d-444c-aff1-6f738b50532e None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:08.596772 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 467/933] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:18:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:08.602778 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f77500-582f-4ecf-98fb-42a4915f1319 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:08.603415 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f77500-582f-4ecf-98fb-42a4915f1319 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:08.603415 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f77500-582f-4ecf-98fb-42a4915f1319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:08.625163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-85f77500-582f-4ecf-98fb-42a4915f1319 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:08.626405 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-85f77500-582f-4ecf-98fb-42a4915f1319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:08.634896 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 467/934] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:18:08.978343 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d8ae5-4e5d-444c-aff1-6f738b50532e None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:08.989819 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d8ae5-4e5d-444c-aff1-6f738b50532e None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:08.993340 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1975380-c183-4588-934b-a29542d4246e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:08.993934 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1975380-c183-4588-934b-a29542d4246e service neutron] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:08.994214 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1975380-c183-4588-934b-a29542d4246e service neutron] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:08.994511 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1975380-c183-4588-934b-a29542d4246e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:09.004592 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1975380-c183-4588-934b-a29542d4246e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:09.006040 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1975380-c183-4588-934b-a29542d4246e service neutron] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:09.015859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 468/935] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:18:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:18:11.547736 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4dd25-4a02-4a7f-adfb-cabe39903902 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:11.548303 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4dd25-4a02-4a7f-adfb-cabe39903902 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:11.548303 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4dd25-4a02-4a7f-adfb-cabe39903902 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:11.549637 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 468/936] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:11.555342 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac308bef-591d-4463-9aeb-5cb75dccbe6b None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:11.555776 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac308bef-591d-4463-9aeb-5cb75dccbe6b None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:11.555980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac308bef-591d-4463-9aeb-5cb75dccbe6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:11.595396 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-ac308bef-591d-4463-9aeb-5cb75dccbe6b None None] MFA Rules not processed for user `7ff34784d9634d5bb6512d1ca036719d`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:11.596668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-ac308bef-591d-4463-9aeb-5cb75dccbe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:11.638959 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:11.670610 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 469/937] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:11 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:18:12.015054 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4dd25-4a02-4a7f-adfb-cabe39903902 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:12.026519 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4dd25-4a02-4a7f-adfb-cabe39903902 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:12.030162 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b629307-f72c-49cb-932f-166483edffde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:12.030759 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b629307-f72c-49cb-932f-166483edffde service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:12.031143 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b629307-f72c-49cb-932f-166483edffde service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:12.031415 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b629307-f72c-49cb-932f-166483edffde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:12.041847 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b629307-f72c-49cb-932f-166483edffde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:12.043314 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b629307-f72c-49cb-932f-166483edffde service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:12.053936 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 469/938] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:18:12 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:18:14.919328 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e967bd7-8309-46e4-affa-d0e802e0deba None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:14.919851 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e967bd7-8309-46e4-affa-d0e802e0deba None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:14.919851 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e967bd7-8309-46e4-affa-d0e802e0deba None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:14.921204 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 470/939] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:14.926829 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a09a8-1e5a-49af-8092-c59c6806942f None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:14.927240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a09a8-1e5a-49af-8092-c59c6806942f None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:14.927418 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a09a8-1e5a-49af-8092-c59c6806942f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:14.947719 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-af5a09a8-1e5a-49af-8092-c59c6806942f None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:14.948918 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-af5a09a8-1e5a-49af-8092-c59c6806942f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:15.020035 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 470/940] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:14 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:18:15.359078 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e967bd7-8309-46e4-affa-d0e802e0deba None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:15.370147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e967bd7-8309-46e4-affa-d0e802e0deba None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:15.373567 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b0a26-21c6-4b29-80c1-94f376bc67f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:15.374151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b0a26-21c6-4b29-80c1-94f376bc67f7 service neutron] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:15.374430 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b0a26-21c6-4b29-80c1-94f376bc67f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:15.374706 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b0a26-21c6-4b29-80c1-94f376bc67f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:15.383408 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b0a26-21c6-4b29-80c1-94f376bc67f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:15.384836 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b0a26-21c6-4b29-80c1-94f376bc67f7 service neutron] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:15.394090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 471/941] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:18:15 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:18:18.213015 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada59dc5-a596-4366-9912-93ffe55fa9db None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:18.213583 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada59dc5-a596-4366-9912-93ffe55fa9db None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:18.213583 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada59dc5-a596-4366-9912-93ffe55fa9db None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:18.214922 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 471/942] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:18.220330 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7478ada-cbb4-4c27-8d2e-dcc724dd2b45 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:18.220768 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7478ada-cbb4-4c27-8d2e-dcc724dd2b45 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:18.220876 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7478ada-cbb4-4c27-8d2e-dcc724dd2b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:18.240115 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-e7478ada-cbb4-4c27-8d2e-dcc724dd2b45 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:18.241312 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-e7478ada-cbb4-4c27-8d2e-dcc724dd2b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:18.249069 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 472/943] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:18:18.601223 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb4a76-ac3b-4ecb-901f-f5d5bf4276a6 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:18.601508 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb4a76-ac3b-4ecb-901f-f5d5bf4276a6 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:18.601806 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb4a76-ac3b-4ecb-901f-f5d5bf4276a6 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:18.603194 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 472/944] 10.222.0.42 () {54 vars in 965 bytes} [Wed Aug 24 00:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:18.609173 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870145e8-b2ba-4509-b132-1064b528839a None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:18.609453 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870145e8-b2ba-4509-b132-1064b528839a None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:18.609726 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870145e8-b2ba-4509-b132-1064b528839a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:18.629359 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-870145e8-b2ba-4509-b132-1064b528839a None None] MFA Rules not processed for user `ad894f6b3613401c88cd3b39d825e61d`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:18.630532 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-870145e8-b2ba-4509-b132-1064b528839a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:18.636923 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 473/945] 10.222.0.42 () {58 vars in 1062 bytes} [Wed Aug 24 00:18:18 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:18:18.646432 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb4a76-ac3b-4ecb-901f-f5d5bf4276a6 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:18.657009 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb4a76-ac3b-4ecb-901f-f5d5bf4276a6 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:18.661044 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af5a7d-da16-4c06-b277-fb4a175ac3a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:18.661676 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af5a7d-da16-4c06-b277-fb4a175ac3a4 service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:18.661965 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af5a7d-da16-4c06-b277-fb4a175ac3a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:18.662341 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af5a7d-da16-4c06-b277-fb4a175ac3a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:18.672746 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af5a7d-da16-4c06-b277-fb4a175ac3a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:18.674448 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af5a7d-da16-4c06-b277-fb4a175ac3a4 service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:18.684518 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 473/946] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:18:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:18:21.135404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bdbd2-1ca0-4421-be8f-90d594764058 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:21.136162 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bdbd2-1ca0-4421-be8f-90d594764058 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:21.136162 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bdbd2-1ca0-4421-be8f-90d594764058 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:21.137309 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 474/947] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:21.142831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f9cfc-0ed1-4684-a881-bf4a7ce8806d None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:21.143341 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f9cfc-0ed1-4684-a881-bf4a7ce8806d None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:21.143467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f9cfc-0ed1-4684-a881-bf4a7ce8806d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:21.165872 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-536f9cfc-0ed1-4684-a881-bf4a7ce8806d None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:21.167142 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-536f9cfc-0ed1-4684-a881-bf4a7ce8806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:21.175177 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 474/948] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:18:21.514189 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bdbd2-1ca0-4421-be8f-90d594764058 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:21.527403 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bdbd2-1ca0-4421-be8f-90d594764058 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:21.539284 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a4583-5318-4e93-bd86-15a699afd4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:21.539985 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a4583-5318-4e93-bd86-15a699afd4df service neutron] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:21.540258 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a4583-5318-4e93-bd86-15a699afd4df service neutron] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:21.540523 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a4583-5318-4e93-bd86-15a699afd4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:21.550891 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a4583-5318-4e93-bd86-15a699afd4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:21.552366 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a4583-5318-4e93-bd86-15a699afd4df service neutron] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:21.562783 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 475/949] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:18:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:18:23.859266 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec411cfd-7192-4771-b163-947ab448eb1b None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:23.859812 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec411cfd-7192-4771-b163-947ab448eb1b None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:23.859812 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec411cfd-7192-4771-b163-947ab448eb1b None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:23.861190 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 475/950] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:23.866470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4495f-694a-40fb-9fa3-c45155184340 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:23.866917 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4495f-694a-40fb-9fa3-c45155184340 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:23.867202 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4495f-694a-40fb-9fa3-c45155184340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:23.886689 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-33f4495f-694a-40fb-9fa3-c45155184340 None None] MFA Rules not processed for user `7ff34784d9634d5bb6512d1ca036719d`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:23.887960 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-33f4495f-694a-40fb-9fa3-c45155184340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:23.896446 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 476/951] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:23 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:18:24.241159 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec411cfd-7192-4771-b163-947ab448eb1b None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:24.251952 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec411cfd-7192-4771-b163-947ab448eb1b None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:24.256029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a2254-d1e8-4fa3-8e0a-0f6577f9caf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:24.256626 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a2254-d1e8-4fa3-8e0a-0f6577f9caf4 service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:24.256904 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a2254-d1e8-4fa3-8e0a-0f6577f9caf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:24.257175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a2254-d1e8-4fa3-8e0a-0f6577f9caf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:24.266813 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a2254-d1e8-4fa3-8e0a-0f6577f9caf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:24.268291 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a2254-d1e8-4fa3-8e0a-0f6577f9caf4 service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:24.278770 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 476/952] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:18:24 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:18:26.837770 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f743564-fefe-4b0e-bbc0-751c8311d5b7 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:26.838285 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f743564-fefe-4b0e-bbc0-751c8311d5b7 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:26.838285 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f743564-fefe-4b0e-bbc0-751c8311d5b7 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:26.839677 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 477/953] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:26.845105 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7371310-df21-4ae5-b9df-dba821dd3d79 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:26.845531 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7371310-df21-4ae5-b9df-dba821dd3d79 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:26.845633 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7371310-df21-4ae5-b9df-dba821dd3d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:26.865151 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-b7371310-df21-4ae5-b9df-dba821dd3d79 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:26.866338 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-b7371310-df21-4ae5-b9df-dba821dd3d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:26.873919 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 477/954] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:18:27.216416 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f743564-fefe-4b0e-bbc0-751c8311d5b7 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:27.226748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f743564-fefe-4b0e-bbc0-751c8311d5b7 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:27.230166 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7037363-5904-48b6-8642-333ea36a1c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:27.230750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7037363-5904-48b6-8642-333ea36a1c95 service neutron] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:27.231053 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7037363-5904-48b6-8642-333ea36a1c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:27.231376 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7037363-5904-48b6-8642-333ea36a1c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:27.240195 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7037363-5904-48b6-8642-333ea36a1c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:27.241613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7037363-5904-48b6-8642-333ea36a1c95 service neutron] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:27.250961 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 478/955] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:18:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:18:29.527996 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abde75-668e-4c42-8a84-f75a76431dc4 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:29.528508 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abde75-668e-4c42-8a84-f75a76431dc4 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:29.528617 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abde75-668e-4c42-8a84-f75a76431dc4 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:29.529891 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 478/956] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:29.535959 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa0587-6492-41fc-9e4e-aa1798ee0548 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:29.536366 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa0587-6492-41fc-9e4e-aa1798ee0548 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:29.536537 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa0587-6492-41fc-9e4e-aa1798ee0548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:29.558772 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-1ffa0587-6492-41fc-9e4e-aa1798ee0548 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:29.559283 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-1ffa0587-6492-41fc-9e4e-aa1798ee0548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:29.567625 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 479/957] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:18:29.908707 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abde75-668e-4c42-8a84-f75a76431dc4 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:29.919979 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abde75-668e-4c42-8a84-f75a76431dc4 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:29.923468 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7d9c1-8c85-44b5-8dcb-f9cd700c269a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:29.924050 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7d9c1-8c85-44b5-8dcb-f9cd700c269a service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:29.924330 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7d9c1-8c85-44b5-8dcb-f9cd700c269a service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:29.924604 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7d9c1-8c85-44b5-8dcb-f9cd700c269a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:29.933616 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7d9c1-8c85-44b5-8dcb-f9cd700c269a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:29.935080 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7d9c1-8c85-44b5-8dcb-f9cd700c269a service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:29.944255 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 479/958] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:18:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:18:32.485526 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1eaf3-20ad-4515-b68c-268cda3763dc None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:32.486076 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1eaf3-20ad-4515-b68c-268cda3763dc None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:32.486076 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1eaf3-20ad-4515-b68c-268cda3763dc None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:32.487502 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 480/959] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:32.493315 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca7155-0d95-4f81-bd9e-6d267326e9ec None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:32.493746 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca7155-0d95-4f81-bd9e-6d267326e9ec None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:32.493871 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca7155-0d95-4f81-bd9e-6d267326e9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:32.513818 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-46ca7155-0d95-4f81-bd9e-6d267326e9ec None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:32.515032 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-46ca7155-0d95-4f81-bd9e-6d267326e9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:32.523329 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 480/960] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:32 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:18:32.870962 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1eaf3-20ad-4515-b68c-268cda3763dc None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:32.881660 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1eaf3-20ad-4515-b68c-268cda3763dc None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:32.885186 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e519e20-29dd-4e6e-a423-6753175c9815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:32.885769 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e519e20-29dd-4e6e-a423-6753175c9815 service neutron] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:32.886049 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e519e20-29dd-4e6e-a423-6753175c9815 service neutron] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:32.886325 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e519e20-29dd-4e6e-a423-6753175c9815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:32.895623 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e519e20-29dd-4e6e-a423-6753175c9815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:32.897057 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e519e20-29dd-4e6e-a423-6753175c9815 service neutron] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:32.906327 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 481/961] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:18:32 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:18:37.031464 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745a87b-1ae1-45cd-af7f-73ce1dc551fb None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:37.032046 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745a87b-1ae1-45cd-af7f-73ce1dc551fb None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:37.032046 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745a87b-1ae1-45cd-af7f-73ce1dc551fb None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:37.033474 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 481/962] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:37.039938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48fc39-2b46-43ef-a81c-f03eda38324e None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:37.040396 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48fc39-2b46-43ef-a81c-f03eda38324e None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:37.040596 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48fc39-2b46-43ef-a81c-f03eda38324e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:37.060583 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-3f48fc39-2b46-43ef-a81c-f03eda38324e None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:37.061768 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-3f48fc39-2b46-43ef-a81c-f03eda38324e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:37.069517 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 482/963] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:18:37.432147 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745a87b-1ae1-45cd-af7f-73ce1dc551fb None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:37.437338 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=74 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:37.443390 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745a87b-1ae1-45cd-af7f-73ce1dc551fb None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:37.446962 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709353c-80c2-493e-9a70-15d4c2df5b76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:37.447589 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709353c-80c2-493e-9a70-15d4c2df5b76 service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:37.447867 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709353c-80c2-493e-9a70-15d4c2df5b76 service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:37.448139 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709353c-80c2-493e-9a70-15d4c2df5b76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:37.457945 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709353c-80c2-493e-9a70-15d4c2df5b76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:37.459425 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709353c-80c2-493e-9a70-15d4c2df5b76 service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:37.468715 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 482/964] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:18:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:18:40.309204 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab54423-e24a-48bb-9ff3-148e10a3b3c3 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:40.309742 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab54423-e24a-48bb-9ff3-148e10a3b3c3 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:40.309742 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab54423-e24a-48bb-9ff3-148e10a3b3c3 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:40.311029 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 483/965] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:40.316907 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b710866-699a-46b8-a71d-fc94a223e0ab None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:40.317333 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b710866-699a-46b8-a71d-fc94a223e0ab None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:40.317465 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b710866-699a-46b8-a71d-fc94a223e0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:40.336234 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-3b710866-699a-46b8-a71d-fc94a223e0ab None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:40.337441 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-3b710866-699a-46b8-a71d-fc94a223e0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:40.345231 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 483/966] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:40 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:18:40.692727 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab54423-e24a-48bb-9ff3-148e10a3b3c3 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:40.704190 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab54423-e24a-48bb-9ff3-148e10a3b3c3 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:40.707929 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cde3bf-b5d1-441a-b132-da85c4929744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:40.708527 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cde3bf-b5d1-441a-b132-da85c4929744 service neutron] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:40.708855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cde3bf-b5d1-441a-b132-da85c4929744 service neutron] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:40.709071 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cde3bf-b5d1-441a-b132-da85c4929744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:40.721117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cde3bf-b5d1-441a-b132-da85c4929744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:40.723084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cde3bf-b5d1-441a-b132-da85c4929744 service neutron] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:40.732597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 484/967] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:18:40 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:18:44.876037 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1059844-4dac-44bf-8d0a-2cdad785c8b2 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:44.876973 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1059844-4dac-44bf-8d0a-2cdad785c8b2 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:44.877490 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1059844-4dac-44bf-8d0a-2cdad785c8b2 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:44.879589 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 484/968] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:18:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:44.885143 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5186c-9f0b-4604-b3d4-64a9f23a6699 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:44.885599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5186c-9f0b-4604-b3d4-64a9f23a6699 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:44.885700 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5186c-9f0b-4604-b3d4-64a9f23a6699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:44.893034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=57 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:44.905684 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-91f5186c-9f0b-4604-b3d4-64a9f23a6699 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:44.906804 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-91f5186c-9f0b-4604-b3d4-64a9f23a6699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:44.914704 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 485/969] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:18:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:18:45.256814 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1059844-4dac-44bf-8d0a-2cdad785c8b2 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:18:45.267532 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1059844-4dac-44bf-8d0a-2cdad785c8b2 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:18:45.270938 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e7682-852e-4fb9-bc69-2b2329502752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:18:45.271557 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e7682-852e-4fb9-bc69-2b2329502752 service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:45.271837 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e7682-852e-4fb9-bc69-2b2329502752 service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:45.272111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e7682-852e-4fb9-bc69-2b2329502752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:45.280957 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e7682-852e-4fb9-bc69-2b2329502752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:18:45.282388 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e7682-852e-4fb9-bc69-2b2329502752 service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:18:45.292596 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 485/970] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:18:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:18:50.751966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b634-4d3e-4bac-a0e6-3ca7f1c478ec None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:50.752392 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b634-4d3e-4bac-a0e6-3ca7f1c478ec None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:50.752547 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b634-4d3e-4bac-a0e6-3ca7f1c478ec None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:50.755901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 486/971] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 24 00:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:50.763022 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5455e11-daba-41df-8adf-637eb1350a6f None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:50.763022 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5455e11-daba-41df-8adf-637eb1350a6f None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:50.763022 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5455e11-daba-41df-8adf-637eb1350a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:50.873323 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-a5455e11-daba-41df-8adf-637eb1350a6f None None] MFA Rules not processed for user `ebffbdf5a1234167903a9fd4490bb174`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:50.874748 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-a5455e11-daba-41df-8adf-637eb1350a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:51.029125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 486/972] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 24 00:18:50 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:18:54.900855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=2 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:18:55.355273 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf8f0c-2a88-47e8-afbd-ef5a54da20e4 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:55.355826 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf8f0c-2a88-47e8-afbd-ef5a54da20e4 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:55.356772 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf8f0c-2a88-47e8-afbd-ef5a54da20e4 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:55.361332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 487/973] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 24 00:18:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:55.369595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1ebf9-b5d4-44ed-83f6-82eca9f7c46e None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:55.370107 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1ebf9-b5d4-44ed-83f6-82eca9f7c46e None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:55.370386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1ebf9-b5d4-44ed-83f6-82eca9f7c46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:55.391593 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-f4f1ebf9-b5d4-44ed-83f6-82eca9f7c46e None None] MFA Rules not processed for user `ebffbdf5a1234167903a9fd4490bb174`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:55.392860 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-f4f1ebf9-b5d4-44ed-83f6-82eca9f7c46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:55.401946 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 487/974] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 24 00:18:55 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:18:57.178798 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2579e-1f4f-4516-8cc7-472bfe60c461 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:57.179348 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2579e-1f4f-4516-8cc7-472bfe60c461 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:57.179348 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2579e-1f4f-4516-8cc7-472bfe60c461 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:57.180689 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 488/975] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 24 00:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:18:57.186202 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6094f7-202a-4b26-b676-bdb5f3d547d2 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:18:57.186645 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6094f7-202a-4b26-b676-bdb5f3d547d2 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:18:57.186828 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6094f7-202a-4b26-b676-bdb5f3d547d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:18:57.206860 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-aa6094f7-202a-4b26-b676-bdb5f3d547d2 None None] MFA Rules not processed for user `ebffbdf5a1234167903a9fd4490bb174`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:18:57.208110 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-aa6094f7-202a-4b26-b676-bdb5f3d547d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:18:57.216712 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 488/976] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 24 00:18:57 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:01.051884 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3758a-0b7f-4e15-9c5f-59c96ba2cfb0 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:01.051884 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3758a-0b7f-4e15-9c5f-59c96ba2cfb0 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:01.052332 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3758a-0b7f-4e15-9c5f-59c96ba2cfb0 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:01.053777 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 489/977] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:01.065478 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab483c2b-0701-436c-8967-91ee72d35e63 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:01.066876 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab483c2b-0701-436c-8967-91ee72d35e63 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:01.067192 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab483c2b-0701-436c-8967-91ee72d35e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:01.098842 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-ab483c2b-0701-436c-8967-91ee72d35e63 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:01.100825 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-ab483c2b-0701-436c-8967-91ee72d35e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:01.114365 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 489/978] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:01.471842 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a615b1-ebfc-4767-a23b-9ef5401f4c54 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:01.472631 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a615b1-ebfc-4767-a23b-9ef5401f4c54 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:01.473455 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a615b1-ebfc-4767-a23b-9ef5401f4c54 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:01.476252 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 490/979] 10.222.0.42 () {54 vars in 962 bytes} [Wed Aug 24 00:19:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:01.485584 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463a40e-45c1-41e1-80ae-653793f4aefa None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:01.486221 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463a40e-45c1-41e1-80ae-653793f4aefa None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:01.487264 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463a40e-45c1-41e1-80ae-653793f4aefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:01.537156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-7463a40e-45c1-41e1-80ae-653793f4aefa None None] MFA Rules not processed for user `a863e95438d14892816e4f3c94673025`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:01.538738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-7463a40e-45c1-41e1-80ae-653793f4aefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:01.610698 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:19:01.619143 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 490/980] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Aug 24 00:19:01 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:19:01.624882 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a615b1-ebfc-4767-a23b-9ef5401f4c54 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:01.638766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a615b1-ebfc-4767-a23b-9ef5401f4c54 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:01.643945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7217f-5592-4d4a-9c5a-ddc8ffa42031 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:01.644538 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7217f-5592-4d4a-9c5a-ddc8ffa42031 service nova] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:01.644816 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7217f-5592-4d4a-9c5a-ddc8ffa42031 service nova] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:01.645084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7217f-5592-4d4a-9c5a-ddc8ffa42031 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:01.653595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7217f-5592-4d4a-9c5a-ddc8ffa42031 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:01.655220 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7217f-5592-4d4a-9c5a-ddc8ffa42031 service nova] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:01.665990 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 491/981] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:04.098970 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e8c7d-a37d-486c-9d3f-53761006f620 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:04.099495 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e8c7d-a37d-486c-9d3f-53761006f620 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:04.099602 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e8c7d-a37d-486c-9d3f-53761006f620 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:04.100925 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 491/982] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:04.106422 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1558b21-3c3d-465b-b0f1-b11652113763 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:04.106885 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1558b21-3c3d-465b-b0f1-b11652113763 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:04.107065 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1558b21-3c3d-465b-b0f1-b11652113763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:04.126067 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-f1558b21-3c3d-465b-b0f1-b11652113763 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:04.127561 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-f1558b21-3c3d-465b-b0f1-b11652113763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:04.139042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 492/983] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:04.481479 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e8c7d-a37d-486c-9d3f-53761006f620 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:04.495686 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e8c7d-a37d-486c-9d3f-53761006f620 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:04.500703 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3e768-a82e-4687-bef5-875e09c7e0aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:04.501307 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3e768-a82e-4687-bef5-875e09c7e0aa service nova] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:04.501589 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3e768-a82e-4687-bef5-875e09c7e0aa service nova] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:04.501864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3e768-a82e-4687-bef5-875e09c7e0aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:04.511195 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3e768-a82e-4687-bef5-875e09c7e0aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:04.512785 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3e768-a82e-4687-bef5-875e09c7e0aa service nova] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:04.523625 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 492/984] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:07.101352 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81408c8f-f7fb-43e4-9e0a-f42a638e2790 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:07.101876 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81408c8f-f7fb-43e4-9e0a-f42a638e2790 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:07.101876 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81408c8f-f7fb-43e4-9e0a-f42a638e2790 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:07.103267 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 493/985] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:07.108756 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e20267-7a81-404f-8b71-edd78e540106 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:07.109132 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e20267-7a81-404f-8b71-edd78e540106 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:07.109453 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e20267-7a81-404f-8b71-edd78e540106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:07.129057 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-39e20267-7a81-404f-8b71-edd78e540106 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:07.130294 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-39e20267-7a81-404f-8b71-edd78e540106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:07.138598 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 493/986] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:07.493872 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80605c7d-c106-4c47-ac9f-59854e1db4f1 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:07.494158 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80605c7d-c106-4c47-ac9f-59854e1db4f1 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:07.494449 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80605c7d-c106-4c47-ac9f-59854e1db4f1 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:07.495819 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 494/987] 10.222.0.42 () {54 vars in 962 bytes} [Wed Aug 24 00:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:07.502979 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bba371-2564-4564-b525-5d083a2e2d57 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:07.503344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bba371-2564-4564-b525-5d083a2e2d57 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:07.503619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bba371-2564-4564-b525-5d083a2e2d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:07.527316 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-51bba371-2564-4564-b525-5d083a2e2d57 None None] MFA Rules not processed for user `a863e95438d14892816e4f3c94673025`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:07.528515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-51bba371-2564-4564-b525-5d083a2e2d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:07.539354 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 494/988] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Aug 24 00:19:07 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:07.547791 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80605c7d-c106-4c47-ac9f-59854e1db4f1 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:07.563852 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80605c7d-c106-4c47-ac9f-59854e1db4f1 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:07.570514 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce58001-fc44-4ef0-bc26-41a7a973e687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:07.571155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce58001-fc44-4ef0-bc26-41a7a973e687 service nova] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:07.571441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce58001-fc44-4ef0-bc26-41a7a973e687 service nova] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:07.571716 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce58001-fc44-4ef0-bc26-41a7a973e687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:07.580382 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce58001-fc44-4ef0-bc26-41a7a973e687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:07.582543 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce58001-fc44-4ef0-bc26-41a7a973e687 service nova] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:07.592441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 495/989] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:10.011723 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635df43-1f66-4211-a686-25f34a63923d None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:10.012665 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635df43-1f66-4211-a686-25f34a63923d None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:10.013104 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635df43-1f66-4211-a686-25f34a63923d None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:10.014637 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 495/990] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:19:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:10.020292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5aa46-d23e-4276-b45f-246b8e223e69 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:10.021109 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5aa46-d23e-4276-b45f-246b8e223e69 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:10.021546 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5aa46-d23e-4276-b45f-246b8e223e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:10.044162 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-b2d5aa46-d23e-4276-b45f-246b8e223e69 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:10.045637 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-b2d5aa46-d23e-4276-b45f-246b8e223e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:10.064517 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 496/991] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:10.425810 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635df43-1f66-4211-a686-25f34a63923d None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:10.440992 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635df43-1f66-4211-a686-25f34a63923d None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:10.448344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6ebe4-7c39-4584-80b3-a44b794691b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:10.449106 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6ebe4-7c39-4584-80b3-a44b794691b0 service nova] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:10.449549 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6ebe4-7c39-4584-80b3-a44b794691b0 service nova] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:10.450013 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6ebe4-7c39-4584-80b3-a44b794691b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:10.460436 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6ebe4-7c39-4584-80b3-a44b794691b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:10.462848 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6ebe4-7c39-4584-80b3-a44b794691b0 service nova] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:10.485486 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 496/992] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:11.603543 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f34c3-d791-4fbb-89a2-f1f231f567c8 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:11.603997 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f34c3-d791-4fbb-89a2-f1f231f567c8 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:11.604103 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f34c3-d791-4fbb-89a2-f1f231f567c8 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:11.609850 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 497/993] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:19:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:11.611504 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcd773-5459-4138-8dd3-c5d66e824b2a None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:11.611937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcd773-5459-4138-8dd3-c5d66e824b2a None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:11.612105 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcd773-5459-4138-8dd3-c5d66e824b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:11.636234 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-7bdcd773-5459-4138-8dd3-c5d66e824b2a None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:11.639149 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-7bdcd773-5459-4138-8dd3-c5d66e824b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:11.662500 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 497/994] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:12.241017 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fcf9d-1dcc-4fdb-afee-86cfda67f1f7 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:12.241307 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fcf9d-1dcc-4fdb-afee-86cfda67f1f7 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:12.241567 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fcf9d-1dcc-4fdb-afee-86cfda67f1f7 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:12.242885 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 498/995] 10.222.0.42 () {54 vars in 964 bytes} [Wed Aug 24 00:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:12.248295 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9c48e-c32d-452e-87af-b18605bade13 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:12.248588 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9c48e-c32d-452e-87af-b18605bade13 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:12.248860 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9c48e-c32d-452e-87af-b18605bade13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:12.290006 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-61f9c48e-c32d-452e-87af-b18605bade13 None None] MFA Rules not processed for user `c43d7aa4ecfc4a598bbaa4f4fc4e4590`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:12.291228 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-61f9c48e-c32d-452e-87af-b18605bade13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:12.355402 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 498/996] 10.222.0.42 () {58 vars in 1061 bytes} [Wed Aug 24 00:19:12 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:12.363644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fcf9d-1dcc-4fdb-afee-86cfda67f1f7 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:12.374967 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fcf9d-1dcc-4fdb-afee-86cfda67f1f7 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:12.378558 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e41ab7-128a-4ffb-ba99-94f580565a45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43d7aa4ecfc4a598bbaa4f4fc4e4590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:12.379286 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e41ab7-128a-4ffb-ba99-94f580565a45 service cinder] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:12.379562 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e41ab7-128a-4ffb-ba99-94f580565a45 service cinder] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:12.379833 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e41ab7-128a-4ffb-ba99-94f580565a45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:12.390110 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e41ab7-128a-4ffb-ba99-94f580565a45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:12.391671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e41ab7-128a-4ffb-ba99-94f580565a45 service cinder] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:12.402369 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 499/997] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:12.766152 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ea01e-6173-45d4-bd45-b811fdc433ed None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:12.766712 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ea01e-6173-45d4-bd45-b811fdc433ed None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:12.766712 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ea01e-6173-45d4-bd45-b811fdc433ed None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:12.768276 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 499/998] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:12.774813 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f150ac-42c1-4433-80d2-ccb90ad9fd8d None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:12.775272 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f150ac-42c1-4433-80d2-ccb90ad9fd8d None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:12.775374 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f150ac-42c1-4433-80d2-ccb90ad9fd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:12.795236 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-17f150ac-42c1-4433-80d2-ccb90ad9fd8d None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:12.796512 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-17f150ac-42c1-4433-80d2-ccb90ad9fd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:12.804585 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 500/999] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:13.163640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ea01e-6173-45d4-bd45-b811fdc433ed None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:13.183904 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ea01e-6173-45d4-bd45-b811fdc433ed None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:13.189784 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a909983-9a95-498b-87e0-74991e5790aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:13.190391 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a909983-9a95-498b-87e0-74991e5790aa service nova] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:13.190778 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a909983-9a95-498b-87e0-74991e5790aa service nova] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:13.191658 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a909983-9a95-498b-87e0-74991e5790aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:13.203409 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a909983-9a95-498b-87e0-74991e5790aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:13.206857 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a909983-9a95-498b-87e0-74991e5790aa service nova] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:13.219706 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 500/1000] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:15.527308 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49ffee-547f-4eba-8d4b-4b6fec635ee1 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:15.527727 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49ffee-547f-4eba-8d4b-4b6fec635ee1 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:15.527861 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49ffee-547f-4eba-8d4b-4b6fec635ee1 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:15.529221 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 501/1001] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:15.534770 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d23b7-9c0f-4977-899a-a22bb5b92507 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:15.535287 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d23b7-9c0f-4977-899a-a22bb5b92507 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:15.535495 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d23b7-9c0f-4977-899a-a22bb5b92507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:15.555014 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-c25d23b7-9c0f-4977-899a-a22bb5b92507 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:15.556457 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-c25d23b7-9c0f-4977-899a-a22bb5b92507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:15.564355 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 501/1002] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:15.917559 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49ffee-547f-4eba-8d4b-4b6fec635ee1 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:15.932347 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49ffee-547f-4eba-8d4b-4b6fec635ee1 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:15.937322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6a910-f667-45d3-9454-7b014f34ccd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:15.937920 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6a910-f667-45d3-9454-7b014f34ccd9 service nova] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:15.938219 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6a910-f667-45d3-9454-7b014f34ccd9 service nova] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:15.938471 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6a910-f667-45d3-9454-7b014f34ccd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:15.947328 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6a910-f667-45d3-9454-7b014f34ccd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:15.948905 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6a910-f667-45d3-9454-7b014f34ccd9 service nova] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:15.958510 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 502/1003] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:18.206854 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6eaefd-d7f5-4b1d-bb15-dc94773eaebc None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:18.207449 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6eaefd-d7f5-4b1d-bb15-dc94773eaebc None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:18.207449 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6eaefd-d7f5-4b1d-bb15-dc94773eaebc None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:18.208785 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 502/1004] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:18.214254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be98b92-801b-4c13-b304-f1659b311d57 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:18.215221 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be98b92-801b-4c13-b304-f1659b311d57 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:18.215604 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be98b92-801b-4c13-b304-f1659b311d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:18.235689 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-8be98b92-801b-4c13-b304-f1659b311d57 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:18.237089 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-8be98b92-801b-4c13-b304-f1659b311d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:18.245272 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 503/1005] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:18.598494 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6eaefd-d7f5-4b1d-bb15-dc94773eaebc None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:18.613205 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6eaefd-d7f5-4b1d-bb15-dc94773eaebc None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:18.618085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0ea33-4f6b-4faa-a218-0e96ea5644d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:18.618683 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0ea33-4f6b-4faa-a218-0e96ea5644d1 service nova] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:18.618962 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0ea33-4f6b-4faa-a218-0e96ea5644d1 service nova] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:18.619270 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0ea33-4f6b-4faa-a218-0e96ea5644d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:18.627812 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0ea33-4f6b-4faa-a218-0e96ea5644d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:18.631156 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0ea33-4f6b-4faa-a218-0e96ea5644d1 service nova] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:18.642966 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 503/1006] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:20.893321 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821c2d1-acf1-405b-af65-f6e2f5c6af54 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:20.894388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821c2d1-acf1-405b-af65-f6e2f5c6af54 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:20.894388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821c2d1-acf1-405b-af65-f6e2f5c6af54 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:20.895787 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 504/1007] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:20.901738 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e013514-106a-409d-a2c4-50cd6c2ee8b1 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:20.902165 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e013514-106a-409d-a2c4-50cd6c2ee8b1 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:20.902450 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e013514-106a-409d-a2c4-50cd6c2ee8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:20.927720 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-6e013514-106a-409d-a2c4-50cd6c2ee8b1 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:20.929149 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-6e013514-106a-409d-a2c4-50cd6c2ee8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:20.937827 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 504/1008] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:21.288439 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821c2d1-acf1-405b-af65-f6e2f5c6af54 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:21.304667 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821c2d1-acf1-405b-af65-f6e2f5c6af54 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:21.310917 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11dc1e-72f4-4eb8-a617-f8b6a741debb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:21.311739 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11dc1e-72f4-4eb8-a617-f8b6a741debb service nova] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:21.312084 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11dc1e-72f4-4eb8-a617-f8b6a741debb service nova] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:21.312429 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11dc1e-72f4-4eb8-a617-f8b6a741debb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:21.323264 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11dc1e-72f4-4eb8-a617-f8b6a741debb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:21.324905 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11dc1e-72f4-4eb8-a617-f8b6a741debb service nova] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:21.335333 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 505/1009] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:19:24.011561 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90efd8-e922-47a3-82a7-8bfb2a3ee6cf None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:24.012309 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90efd8-e922-47a3-82a7-8bfb2a3ee6cf None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:24.012309 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90efd8-e922-47a3-82a7-8bfb2a3ee6cf None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:24.013459 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 505/1010] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:24.018730 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fbad0-e6e8-4170-a8b0-3051c982ee18 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:24.019287 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fbad0-e6e8-4170-a8b0-3051c982ee18 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:24.019287 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fbad0-e6e8-4170-a8b0-3051c982ee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:24.040968 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-6c7fbad0-e6e8-4170-a8b0-3051c982ee18 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:24.042952 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-6c7fbad0-e6e8-4170-a8b0-3051c982ee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:24.053865 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 506/1011] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:24.412086 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90efd8-e922-47a3-82a7-8bfb2a3ee6cf None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:24.427531 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90efd8-e922-47a3-82a7-8bfb2a3ee6cf None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:24.432656 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02faac-18a7-4144-97f4-ba48ed91687e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:24.433248 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02faac-18a7-4144-97f4-ba48ed91687e service nova] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:24.433521 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02faac-18a7-4144-97f4-ba48ed91687e service nova] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:24.433793 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02faac-18a7-4144-97f4-ba48ed91687e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:24.442366 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02faac-18a7-4144-97f4-ba48ed91687e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:24.444554 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02faac-18a7-4144-97f4-ba48ed91687e service nova] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:24.458233 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 506/1012] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:27.417919 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c0704-e030-411f-aab4-527807c71e02 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:27.418570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c0704-e030-411f-aab4-527807c71e02 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:27.418570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c0704-e030-411f-aab4-527807c71e02 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:27.419843 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 507/1013] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:27.426065 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a030dd-9bca-422b-9a78-40ef418eaa36 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:27.426659 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a030dd-9bca-422b-9a78-40ef418eaa36 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:27.426659 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a030dd-9bca-422b-9a78-40ef418eaa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:27.447266 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-29a030dd-9bca-422b-9a78-40ef418eaa36 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:27.448472 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-29a030dd-9bca-422b-9a78-40ef418eaa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:27.456343 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 507/1014] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:27.796635 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c0704-e030-411f-aab4-527807c71e02 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:27.804514 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=46 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:19:27.811704 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c0704-e030-411f-aab4-527807c71e02 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:27.816594 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6cc70-50f3-41f1-9e33-0924dcf069c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:27.817180 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6cc70-50f3-41f1-9e33-0924dcf069c6 service nova] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:27.817452 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6cc70-50f3-41f1-9e33-0924dcf069c6 service nova] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:27.817716 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6cc70-50f3-41f1-9e33-0924dcf069c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:27.825824 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6cc70-50f3-41f1-9e33-0924dcf069c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:27.827483 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6cc70-50f3-41f1-9e33-0924dcf069c6 service nova] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:27.837799 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 508/1015] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:28.528938 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d1628-cb39-412e-958d-208f0e11a03f None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:28.529455 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d1628-cb39-412e-958d-208f0e11a03f None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:28.529644 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d1628-cb39-412e-958d-208f0e11a03f None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:28.531105 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 508/1016] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:28.537169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908664a8-a8c8-441a-80bd-f97ba54c3ac4 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:28.537572 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908664a8-a8c8-441a-80bd-f97ba54c3ac4 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:28.537722 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908664a8-a8c8-441a-80bd-f97ba54c3ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:28.557946 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-908664a8-a8c8-441a-80bd-f97ba54c3ac4 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:28.559177 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-908664a8-a8c8-441a-80bd-f97ba54c3ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:28.567105 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 509/1017] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:28.920831 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b4e3e-42a0-42ab-a927-ec8cba78f690 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:28.921118 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b4e3e-42a0-42ab-a927-ec8cba78f690 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:28.921395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b4e3e-42a0-42ab-a927-ec8cba78f690 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:28.922730 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 509/1018] 10.222.0.42 () {54 vars in 967 bytes} [Wed Aug 24 00:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:28.928693 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384792a4-5fcb-454a-b416-bfdd96428f51 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:28.929005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384792a4-5fcb-454a-b416-bfdd96428f51 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:28.929280 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384792a4-5fcb-454a-b416-bfdd96428f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:28.967930 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-384792a4-5fcb-454a-b416-bfdd96428f51 None None] MFA Rules not processed for user `b588c52178934bce8cceff804a8f6e38`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:28.969185 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-384792a4-5fcb-454a-b416-bfdd96428f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:29.057457 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 510/1019] 10.222.0.42 () {58 vars in 1064 bytes} [Wed Aug 24 00:19:28 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:29.065070 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b4e3e-42a0-42ab-a927-ec8cba78f690 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:29.075965 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b4e3e-42a0-42ab-a927-ec8cba78f690 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:29.079458 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a07cd6-a339-42d6-884c-934630299c26 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b588c52178934bce8cceff804a8f6e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:29.080039 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a07cd6-a339-42d6-884c-934630299c26 service glance] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:29.080316 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a07cd6-a339-42d6-884c-934630299c26 service glance] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:29.080647 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a07cd6-a339-42d6-884c-934630299c26 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:29.091617 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a07cd6-a339-42d6-884c-934630299c26 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:29.093064 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a07cd6-a339-42d6-884c-934630299c26 service glance] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:29.103467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 510/1020] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:30.106123 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c00cc-7196-42f6-a6c1-d975699cf275 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:30.106742 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c00cc-7196-42f6-a6c1-d975699cf275 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:30.106742 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c00cc-7196-42f6-a6c1-d975699cf275 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:30.108034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 511/1021] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:30.113818 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a7053-567c-40ee-ac3a-1e2d42dc22b6 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:30.114332 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a7053-567c-40ee-ac3a-1e2d42dc22b6 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:30.114416 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a7053-567c-40ee-ac3a-1e2d42dc22b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:30.133510 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-e38a7053-567c-40ee-ac3a-1e2d42dc22b6 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:30.134730 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-e38a7053-567c-40ee-ac3a-1e2d42dc22b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:30.142859 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 511/1022] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:30.500169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c00cc-7196-42f6-a6c1-d975699cf275 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:30.519662 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c00cc-7196-42f6-a6c1-d975699cf275 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:30.528416 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a35c9-09ad-4f5c-8a12-443afbbaf64a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:30.545760 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a35c9-09ad-4f5c-8a12-443afbbaf64a service nova] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:30.545760 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a35c9-09ad-4f5c-8a12-443afbbaf64a service nova] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:30.545760 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a35c9-09ad-4f5c-8a12-443afbbaf64a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:30.545760 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a35c9-09ad-4f5c-8a12-443afbbaf64a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:30.545760 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a35c9-09ad-4f5c-8a12-443afbbaf64a service nova] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:30.553325 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 512/1023] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:32.808120 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f906ee-f8a5-4109-9172-1e2b2d2f29d2 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:32.808724 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f906ee-f8a5-4109-9172-1e2b2d2f29d2 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:32.808724 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f906ee-f8a5-4109-9172-1e2b2d2f29d2 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:32.809896 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 512/1024] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:32.815160 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93f951-d831-4c26-a227-8f09b55fbb4c None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:32.815699 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93f951-d831-4c26-a227-8f09b55fbb4c None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:32.815699 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93f951-d831-4c26-a227-8f09b55fbb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:32.835544 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-8c93f951-d831-4c26-a227-8f09b55fbb4c None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:32.836935 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-8c93f951-d831-4c26-a227-8f09b55fbb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:32.844722 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 513/1025] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:19:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:33.195053 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f906ee-f8a5-4109-9172-1e2b2d2f29d2 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:33.202776 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=92 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:19:33.213035 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f906ee-f8a5-4109-9172-1e2b2d2f29d2 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:33.217862 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cdf92-7e7c-40cc-957a-c8ff30c185b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:33.218467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cdf92-7e7c-40cc-957a-c8ff30c185b3 service nova] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:33.218746 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cdf92-7e7c-40cc-957a-c8ff30c185b3 service nova] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:33.219064 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cdf92-7e7c-40cc-957a-c8ff30c185b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:33.228423 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cdf92-7e7c-40cc-957a-c8ff30c185b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:33.230409 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cdf92-7e7c-40cc-957a-c8ff30c185b3 service nova] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:33.240674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 513/1026] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:42.830194 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=50 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:19:43.236273 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=5 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:19:44.265817 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca5726-2c90-4d4c-9313-780ddf6d9b55 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:44.266401 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca5726-2c90-4d4c-9313-780ddf6d9b55 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:44.266401 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca5726-2c90-4d4c-9313-780ddf6d9b55 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:44.267709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 514/1027] 10.222.0.42 () {54 vars in 918 bytes} [Wed Aug 24 00:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:44.273198 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a25441-ebe7-422c-8b3b-3099c89120d4 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:44.273666 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a25441-ebe7-422c-8b3b-3099c89120d4 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:44.273770 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a25441-ebe7-422c-8b3b-3099c89120d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:44.294042 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-92a25441-ebe7-422c-8b3b-3099c89120d4 None None] MFA Rules not processed for user `ebffbdf5a1234167903a9fd4490bb174`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:44.295258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-92a25441-ebe7-422c-8b3b-3099c89120d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:44.303608 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 514/1028] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Aug 24 00:19:44 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:44.318263 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c620ae-7a24-4cfd-8335-60116a3d2bb5 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:44.318551 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c620ae-7a24-4cfd-8335-60116a3d2bb5 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:44.318830 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c620ae-7a24-4cfd-8335-60116a3d2bb5 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:44.320179 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 515/1029] 10.222.0.42 () {54 vars in 918 bytes} [Wed Aug 24 00:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:44.324755 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad297e9-c971-484d-963f-576468142a34 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:44.325041 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad297e9-c971-484d-963f-576468142a34 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:44.325317 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad297e9-c971-484d-963f-576468142a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:44.344613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-dad297e9-c971-484d-963f-576468142a34 None None] MFA Rules not processed for user `a863e95438d14892816e4f3c94673025`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:44.345785 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-dad297e9-c971-484d-963f-576468142a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:44.354405 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 515/1030] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Aug 24 00:19:44 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:19:47.028459 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ac2e8-4362-426c-8698-54750f724eb3 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:47.029048 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ac2e8-4362-426c-8698-54750f724eb3 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:47.029048 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ac2e8-4362-426c-8698-54750f724eb3 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:47.030334 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 516/1031] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:47.036186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5564a2-df98-400a-8bfa-19ef332a5f04 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:47.036609 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5564a2-df98-400a-8bfa-19ef332a5f04 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:47.036746 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5564a2-df98-400a-8bfa-19ef332a5f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:47.055440 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-fd5564a2-df98-400a-8bfa-19ef332a5f04 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:47.056914 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-fd5564a2-df98-400a-8bfa-19ef332a5f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:47.064631 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 516/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:19:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:47.409452 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ac2e8-4362-426c-8698-54750f724eb3 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:47.423518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ac2e8-4362-426c-8698-54750f724eb3 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:47.428390 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f44c27-2bb9-4738-9423-a6d418c04b75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:47.428981 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f44c27-2bb9-4738-9423-a6d418c04b75 service nova] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:47.429262 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f44c27-2bb9-4738-9423-a6d418c04b75 service nova] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:47.429536 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f44c27-2bb9-4738-9423-a6d418c04b75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:47.437896 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f44c27-2bb9-4738-9423-a6d418c04b75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:47.439532 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f44c27-2bb9-4738-9423-a6d418c04b75 service nova] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:47.449424 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 517/1033] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:48.383287 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768405c3-035b-4177-8ea3-29eaa03d0ab7 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:48.383841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768405c3-035b-4177-8ea3-29eaa03d0ab7 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:48.383989 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768405c3-035b-4177-8ea3-29eaa03d0ab7 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:48.385358 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 517/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:48.390219 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8522a-d570-4ca1-98db-661572ca6b7d None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:48.390629 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8522a-d570-4ca1-98db-661572ca6b7d None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:48.390803 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8522a-d570-4ca1-98db-661572ca6b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:48.410417 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-dbe8522a-d570-4ca1-98db-661572ca6b7d None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:48.411655 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-dbe8522a-d570-4ca1-98db-661572ca6b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:48.419599 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 518/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:19:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:48.604272 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768405c3-035b-4177-8ea3-29eaa03d0ab7 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:48.617624 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768405c3-035b-4177-8ea3-29eaa03d0ab7 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:48.622508 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cca8c-6901-45b7-9654-65194167c460 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:48.623131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cca8c-6901-45b7-9654-65194167c460 service nova] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:48.623411 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cca8c-6901-45b7-9654-65194167c460 service nova] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:48.623672 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cca8c-6901-45b7-9654-65194167c460 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:48.631628 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cca8c-6901-45b7-9654-65194167c460 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:48.633211 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cca8c-6901-45b7-9654-65194167c460 service nova] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:48.642540 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 518/1036] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:49.538572 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c68d8-79ed-4902-9361-cbcf743521f5 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:49.539095 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c68d8-79ed-4902-9361-cbcf743521f5 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:49.539192 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c68d8-79ed-4902-9361-cbcf743521f5 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:49.540478 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 519/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:49.545346 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637be10-be86-43ed-a4f8-db08e27f5647 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:49.545753 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637be10-be86-43ed-a4f8-db08e27f5647 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:49.545896 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637be10-be86-43ed-a4f8-db08e27f5647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:49.565240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-c637be10-be86-43ed-a4f8-db08e27f5647 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:49.567049 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-c637be10-be86-43ed-a4f8-db08e27f5647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:49.574902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 519/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:19:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:49.728988 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c68d8-79ed-4902-9361-cbcf743521f5 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:49.742236 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c68d8-79ed-4902-9361-cbcf743521f5 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:49.747180 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e28c6-a2e3-423d-9257-cb348ade74fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:49.747762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e28c6-a2e3-423d-9257-cb348ade74fb service nova] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:49.748038 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e28c6-a2e3-423d-9257-cb348ade74fb service nova] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:49.748324 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e28c6-a2e3-423d-9257-cb348ade74fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:49.758754 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e28c6-a2e3-423d-9257-cb348ade74fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:49.760388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e28c6-a2e3-423d-9257-cb348ade74fb service nova] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:49.770437 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 520/1039] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:50.632594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489be92d-d8a7-40a0-8a00-d3cce774ed6b None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:50.633161 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489be92d-d8a7-40a0-8a00-d3cce774ed6b None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:50.633161 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489be92d-d8a7-40a0-8a00-d3cce774ed6b None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:50.634467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 520/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:50.639602 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5c658-3644-460b-bdee-578cfe7b4b51 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:50.639981 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5c658-3644-460b-bdee-578cfe7b4b51 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:50.640142 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5c658-3644-460b-bdee-578cfe7b4b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:50.660082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-e5f5c658-3644-460b-bdee-578cfe7b4b51 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:50.661281 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-e5f5c658-3644-460b-bdee-578cfe7b4b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:50.669104 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 521/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:19:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:50.823018 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489be92d-d8a7-40a0-8a00-d3cce774ed6b None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:50.836407 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489be92d-d8a7-40a0-8a00-d3cce774ed6b None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:50.841337 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77927e60-0235-42e6-ae17-2edbd709f715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:50.841951 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77927e60-0235-42e6-ae17-2edbd709f715 service nova] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:50.842244 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77927e60-0235-42e6-ae17-2edbd709f715 service nova] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:50.842517 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77927e60-0235-42e6-ae17-2edbd709f715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:50.850610 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77927e60-0235-42e6-ae17-2edbd709f715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:50.852232 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77927e60-0235-42e6-ae17-2edbd709f715 service nova] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:50.861474 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 521/1042] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:51.727090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dca129-ed95-4c14-b9a7-b580f0b6167f None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:51.727684 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dca129-ed95-4c14-b9a7-b580f0b6167f None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:51.727684 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dca129-ed95-4c14-b9a7-b580f0b6167f None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:51.728946 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 522/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:51.733743 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc993d97-620b-459d-ba95-f572c2dd9bcd None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:51.734175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc993d97-620b-459d-ba95-f572c2dd9bcd None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:51.734279 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc993d97-620b-459d-ba95-f572c2dd9bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:51.754397 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-fc993d97-620b-459d-ba95-f572c2dd9bcd None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:51.755623 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-fc993d97-620b-459d-ba95-f572c2dd9bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:51.763484 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 522/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:19:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:51.915793 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dca129-ed95-4c14-b9a7-b580f0b6167f None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:51.929526 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dca129-ed95-4c14-b9a7-b580f0b6167f None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:51.934697 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68972bfa-af6f-441d-93ac-3f23dedb9732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:51.935310 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68972bfa-af6f-441d-93ac-3f23dedb9732 service nova] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:51.935585 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68972bfa-af6f-441d-93ac-3f23dedb9732 service nova] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:51.935851 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68972bfa-af6f-441d-93ac-3f23dedb9732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:51.943748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68972bfa-af6f-441d-93ac-3f23dedb9732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:51.945318 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68972bfa-af6f-441d-93ac-3f23dedb9732 service nova] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:51.955297 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 523/1045] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:52.761953 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b4eac-bd32-4410-b0a0-b0d34a70cca9 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:52.762482 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b4eac-bd32-4410-b0a0-b0d34a70cca9 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:52.762589 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b4eac-bd32-4410-b0a0-b0d34a70cca9 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:52.763978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 523/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:52.769003 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6d547-ec96-42b2-ab03-a9d24e275f0c None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:52.769935 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6d547-ec96-42b2-ab03-a9d24e275f0c None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:52.770138 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6d547-ec96-42b2-ab03-a9d24e275f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:52.788918 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-72e6d547-ec96-42b2-ab03-a9d24e275f0c None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:52.790130 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-72e6d547-ec96-42b2-ab03-a9d24e275f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:52.797855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 524/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:19:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:52.952655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b4eac-bd32-4410-b0a0-b0d34a70cca9 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:52.966163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b4eac-bd32-4410-b0a0-b0d34a70cca9 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:52.970960 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4a375-2ac1-4d5d-8ec1-793e0acc0e01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:52.971573 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4a375-2ac1-4d5d-8ec1-793e0acc0e01 service nova] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:52.971850 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4a375-2ac1-4d5d-8ec1-793e0acc0e01 service nova] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:52.972141 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4a375-2ac1-4d5d-8ec1-793e0acc0e01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:52.980141 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4a375-2ac1-4d5d-8ec1-793e0acc0e01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:52.981718 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4a375-2ac1-4d5d-8ec1-793e0acc0e01 service nova] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:52.991458 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 524/1048] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:53.811388 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feee763-51e3-4a7e-9dce-de74d3a73580 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:53.811928 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feee763-51e3-4a7e-9dce-de74d3a73580 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:53.811928 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feee763-51e3-4a7e-9dce-de74d3a73580 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:53.813183 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 525/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:19:53.818125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1789c9-aa27-43db-91c2-db34adccadb6 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:53.818553 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1789c9-aa27-43db-91c2-db34adccadb6 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:53.818753 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1789c9-aa27-43db-91c2-db34adccadb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:53.839090 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-4a1789c9-aa27-43db-91c2-db34adccadb6 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:53.840287 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-4a1789c9-aa27-43db-91c2-db34adccadb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:53.849640 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 525/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:19:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:54.003518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feee763-51e3-4a7e-9dce-de74d3a73580 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:54.016919 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feee763-51e3-4a7e-9dce-de74d3a73580 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:54.022254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520e75a-335c-4b96-9982-8c8ac89f2099 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:54.022831 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520e75a-335c-4b96-9982-8c8ac89f2099 service nova] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:54.023143 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520e75a-335c-4b96-9982-8c8ac89f2099 service nova] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:54.023414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520e75a-335c-4b96-9982-8c8ac89f2099 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:54.031286 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520e75a-335c-4b96-9982-8c8ac89f2099 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:54.032850 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520e75a-335c-4b96-9982-8c8ac89f2099 service nova] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:54.043021 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 526/1051] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:54.842493 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76895324-c4e4-43a7-9cf1-a4d0df2897ba None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:54.843059 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76895324-c4e4-43a7-9cf1-a4d0df2897ba None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:54.843187 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76895324-c4e4-43a7-9cf1-a4d0df2897ba None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:54.844505 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 526/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:54.850329 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693e59c-7872-41e7-8d02-9410b7af0ffd None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:54.852391 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693e59c-7872-41e7-8d02-9410b7af0ffd None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:54.852391 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693e59c-7872-41e7-8d02-9410b7af0ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:54.870839 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-0693e59c-7872-41e7-8d02-9410b7af0ffd None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:54.872070 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-0693e59c-7872-41e7-8d02-9410b7af0ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:54.884370 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 527/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:19:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:55.041783 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76895324-c4e4-43a7-9cf1-a4d0df2897ba None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:55.056953 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76895324-c4e4-43a7-9cf1-a4d0df2897ba None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:55.062071 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d7fb1-b3c1-4d50-b4a9-42a1b89402c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:55.062670 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d7fb1-b3c1-4d50-b4a9-42a1b89402c5 service nova] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:55.062947 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d7fb1-b3c1-4d50-b4a9-42a1b89402c5 service nova] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:55.063261 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d7fb1-b3c1-4d50-b4a9-42a1b89402c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:55.072941 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d7fb1-b3c1-4d50-b4a9-42a1b89402c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:55.074545 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d7fb1-b3c1-4d50-b4a9-42a1b89402c5 service nova] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:55.084409 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 527/1054] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:19:55.895984 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bafd9-5cfe-43e8-9799-c34c9220c7db None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:55.896503 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bafd9-5cfe-43e8-9799-c34c9220c7db None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:55.896503 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bafd9-5cfe-43e8-9799-c34c9220c7db None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:55.897798 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 528/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:19:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:55.902653 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1b111-130c-4f31-a231-758f8f0f892e None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:55.903085 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1b111-130c-4f31-a231-758f8f0f892e None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:55.903286 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1b111-130c-4f31-a231-758f8f0f892e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:55.922253 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-09c1b111-130c-4f31-a231-758f8f0f892e None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:55.923473 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-09c1b111-130c-4f31-a231-758f8f0f892e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:55.932179 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 528/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:19:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:56.084816 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28bafd9-5cfe-43e8-9799-c34c9220c7db None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:56.098138 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28bafd9-5cfe-43e8-9799-c34c9220c7db None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:56.103307 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2fb2c-0670-49b3-9c8b-e214348ccc8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:56.103901 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2fb2c-0670-49b3-9c8b-e214348ccc8e service nova] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:56.104181 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2fb2c-0670-49b3-9c8b-e214348ccc8e service nova] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:56.104456 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2fb2c-0670-49b3-9c8b-e214348ccc8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:56.113110 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2fb2c-0670-49b3-9c8b-e214348ccc8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:56.114701 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2fb2c-0670-49b3-9c8b-e214348ccc8e service nova] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:56.123900 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 529/1057] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:19:58.216195 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f79537-f4fe-46b4-a310-7a40cc7f5635 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:58.216776 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f79537-f4fe-46b4-a310-7a40cc7f5635 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:58.216776 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f79537-f4fe-46b4-a310-7a40cc7f5635 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:58.218176 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 529/1058] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:19:58.224293 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff86cb1-dba0-4a6c-abc7-0a0b6fcc05d2 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:58.224707 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff86cb1-dba0-4a6c-abc7-0a0b6fcc05d2 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:58.224850 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff86cb1-dba0-4a6c-abc7-0a0b6fcc05d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:58.243642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-6ff86cb1-dba0-4a6c-abc7-0a0b6fcc05d2 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:19:58.244838 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-6ff86cb1-dba0-4a6c-abc7-0a0b6fcc05d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:19:58.252790 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 530/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:19:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:19:58.594183 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f79537-f4fe-46b4-a310-7a40cc7f5635 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:19:58.604685 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f79537-f4fe-46b4-a310-7a40cc7f5635 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:19:58.608117 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336f94f-a85f-422a-844c-de2543a2e605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:19:58.608697 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336f94f-a85f-422a-844c-de2543a2e605 service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:19:58.608973 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336f94f-a85f-422a-844c-de2543a2e605 service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:19:58.609241 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336f94f-a85f-422a-844c-de2543a2e605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:19:58.617926 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336f94f-a85f-422a-844c-de2543a2e605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:19:58.619378 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336f94f-a85f-422a-844c-de2543a2e605 service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:19:58.629025 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 530/1060] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:19:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:00.959912 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ccefc-b6f2-4d62-8a8d-c799b1df4e3e None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:00.960495 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ccefc-b6f2-4d62-8a8d-c799b1df4e3e None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:00.960495 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ccefc-b6f2-4d62-8a8d-c799b1df4e3e None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:00.961806 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 531/1061] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:00.966986 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852915db-9394-46d2-a4a6-7cab59c300d2 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:00.967398 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852915db-9394-46d2-a4a6-7cab59c300d2 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:00.967574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852915db-9394-46d2-a4a6-7cab59c300d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:00.986238 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-852915db-9394-46d2-a4a6-7cab59c300d2 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:00.987464 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-852915db-9394-46d2-a4a6-7cab59c300d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:00.995497 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 531/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:20:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:20:01.348945 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ccefc-b6f2-4d62-8a8d-c799b1df4e3e None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:01.359804 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ccefc-b6f2-4d62-8a8d-c799b1df4e3e None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:01.363842 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47b444-bb05-45ab-b701-069aa5610b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:01.364427 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47b444-bb05-45ab-b701-069aa5610b0b service neutron] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:01.364719 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47b444-bb05-45ab-b701-069aa5610b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:01.364974 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47b444-bb05-45ab-b701-069aa5610b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:01.373832 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47b444-bb05-45ab-b701-069aa5610b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:01.375290 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47b444-bb05-45ab-b701-069aa5610b0b service neutron] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:01.385222 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 532/1063] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:03.884385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec64208-9490-4eda-bd14-ec8c058fc7bb None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:03.884918 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec64208-9490-4eda-bd14-ec8c058fc7bb None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:03.884918 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec64208-9490-4eda-bd14-ec8c058fc7bb None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:03.886252 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 532/1064] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:03.891522 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6f5ad-7f84-4b78-bcef-9559d376e964 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:03.891919 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6f5ad-7f84-4b78-bcef-9559d376e964 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:03.892075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6f5ad-7f84-4b78-bcef-9559d376e964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:03.911309 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-29b6f5ad-7f84-4b78-bcef-9559d376e964 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:03.912506 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-29b6f5ad-7f84-4b78-bcef-9559d376e964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:03.923191 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 533/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:20:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:04.267237 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec64208-9490-4eda-bd14-ec8c058fc7bb None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:04.278230 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec64208-9490-4eda-bd14-ec8c058fc7bb None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:04.281657 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf3391-c402-48c8-a2d1-d07ac09d754d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:04.282238 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf3391-c402-48c8-a2d1-d07ac09d754d service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:04.282512 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf3391-c402-48c8-a2d1-d07ac09d754d service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:04.282778 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf3391-c402-48c8-a2d1-d07ac09d754d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:04.291968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf3391-c402-48c8-a2d1-d07ac09d754d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:04.293389 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf3391-c402-48c8-a2d1-d07ac09d754d service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:04.302725 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 533/1066] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:06.600304 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeba16-93a2-43aa-96b2-87d7308d7e35 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:06.601286 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeba16-93a2-43aa-96b2-87d7308d7e35 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:06.601518 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeba16-93a2-43aa-96b2-87d7308d7e35 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:06.603213 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 534/1067] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:06.608842 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd700700-0fbe-4e66-ad6c-b555dbba5fb5 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:06.609289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd700700-0fbe-4e66-ad6c-b555dbba5fb5 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:06.609387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd700700-0fbe-4e66-ad6c-b555dbba5fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:06.629505 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-cd700700-0fbe-4e66-ad6c-b555dbba5fb5 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:06.630661 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-cd700700-0fbe-4e66-ad6c-b555dbba5fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:06.638303 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 534/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:20:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:06.981639 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeba16-93a2-43aa-96b2-87d7308d7e35 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:06.993179 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeba16-93a2-43aa-96b2-87d7308d7e35 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:06.996701 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fec52a-8dac-4f34-88b8-eb9cd81437f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:06.997289 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fec52a-8dac-4f34-88b8-eb9cd81437f2 service neutron] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:06.997569 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fec52a-8dac-4f34-88b8-eb9cd81437f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:06.997845 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fec52a-8dac-4f34-88b8-eb9cd81437f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:07.006657 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fec52a-8dac-4f34-88b8-eb9cd81437f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:07.008128 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fec52a-8dac-4f34-88b8-eb9cd81437f2 service neutron] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:07.017393 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 535/1069] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:09.240572 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbcac4-5828-485a-ab9a-749e13f67d52 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:09.241141 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbcac4-5828-485a-ab9a-749e13f67d52 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:09.241141 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbcac4-5828-485a-ab9a-749e13f67d52 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:09.242413 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 535/1070] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:09.248065 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3d209-6d13-4932-8b37-b2e098c9ba55 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:09.248461 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3d209-6d13-4932-8b37-b2e098c9ba55 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:09.248609 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3d209-6d13-4932-8b37-b2e098c9ba55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:09.267802 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-cbf3d209-6d13-4932-8b37-b2e098c9ba55 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:09.268988 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-cbf3d209-6d13-4932-8b37-b2e098c9ba55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:09.276641 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 536/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:20:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:09.615280 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbcac4-5828-485a-ab9a-749e13f67d52 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:09.626081 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbcac4-5828-485a-ab9a-749e13f67d52 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:09.629545 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a15c16-5a8c-405c-b44e-71f1c71e228f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:09.630124 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a15c16-5a8c-405c-b44e-71f1c71e228f service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:09.630402 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a15c16-5a8c-405c-b44e-71f1c71e228f service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:09.630701 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a15c16-5a8c-405c-b44e-71f1c71e228f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:09.639425 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a15c16-5a8c-405c-b44e-71f1c71e228f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:09.640841 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a15c16-5a8c-405c-b44e-71f1c71e228f service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:09.650694 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 536/1072] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:11.879546 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1474fb9-d6ab-4cbc-9ce7-78b974bb9a14 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:11.880102 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1474fb9-d6ab-4cbc-9ce7-78b974bb9a14 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:11.880102 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1474fb9-d6ab-4cbc-9ce7-78b974bb9a14 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:11.881347 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 537/1073] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:11.886839 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606f2b8-6b08-4def-99b2-d10f08a05649 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:11.887314 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606f2b8-6b08-4def-99b2-d10f08a05649 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:11.887437 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606f2b8-6b08-4def-99b2-d10f08a05649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:11.906489 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-8606f2b8-6b08-4def-99b2-d10f08a05649 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:11.907720 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-8606f2b8-6b08-4def-99b2-d10f08a05649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:11.916040 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 537/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:20:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:12.258426 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1474fb9-d6ab-4cbc-9ce7-78b974bb9a14 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:12.269481 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1474fb9-d6ab-4cbc-9ce7-78b974bb9a14 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:12.272907 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6be20-8586-4bbd-9045-73142ad5a0b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:12.273490 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6be20-8586-4bbd-9045-73142ad5a0b4 service neutron] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:12.273843 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6be20-8586-4bbd-9045-73142ad5a0b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:12.274027 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6be20-8586-4bbd-9045-73142ad5a0b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:12.282980 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6be20-8586-4bbd-9045-73142ad5a0b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:12.284543 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6be20-8586-4bbd-9045-73142ad5a0b4 service neutron] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:12.293956 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 538/1075] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:14.527301 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cba6e-51d6-4b58-a819-882303465df8 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:14.527741 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cba6e-51d6-4b58-a819-882303465df8 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:14.527837 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cba6e-51d6-4b58-a819-882303465df8 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:14.529205 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 538/1076] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:14.534405 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6942f94-d7a6-4765-b4f0-e930ce75057e None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:14.534776 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6942f94-d7a6-4765-b4f0-e930ce75057e None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:14.534949 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6942f94-d7a6-4765-b4f0-e930ce75057e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:14.542222 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=70 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:20:14.554883 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-f6942f94-d7a6-4765-b4f0-e930ce75057e None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:14.556122 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-f6942f94-d7a6-4765-b4f0-e930ce75057e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:14.564106 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 539/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:20:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:14.900646 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cba6e-51d6-4b58-a819-882303465df8 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:14.906330 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=73 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:20:14.913277 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cba6e-51d6-4b58-a819-882303465df8 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:14.916962 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ca46a-acd5-4dd4-b96a-87d37ee35d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:14.917552 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ca46a-acd5-4dd4-b96a-87d37ee35d44 service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:14.917829 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ca46a-acd5-4dd4-b96a-87d37ee35d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:14.918101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ca46a-acd5-4dd4-b96a-87d37ee35d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:14.926843 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ca46a-acd5-4dd4-b96a-87d37ee35d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:14.928316 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ca46a-acd5-4dd4-b96a-87d37ee35d44 service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:14.937825 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 539/1078] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:17.179702 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48182ee3-b25b-4354-9774-e45fd140c053 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:17.180230 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48182ee3-b25b-4354-9774-e45fd140c053 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:17.180230 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48182ee3-b25b-4354-9774-e45fd140c053 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:17.181503 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 540/1079] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:17.187614 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7e9cb-97d2-4308-b921-c40b01fb4316 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:17.187614 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7e9cb-97d2-4308-b921-c40b01fb4316 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:17.188151 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7e9cb-97d2-4308-b921-c40b01fb4316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:17.206913 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-2ed7e9cb-97d2-4308-b921-c40b01fb4316 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:17.208116 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-2ed7e9cb-97d2-4308-b921-c40b01fb4316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:17.215798 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 540/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:20:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:17.555522 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48182ee3-b25b-4354-9774-e45fd140c053 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:17.566545 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48182ee3-b25b-4354-9774-e45fd140c053 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:17.570009 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb18e4c-7ed2-4815-b30f-89aae5b3d79f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:17.570593 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb18e4c-7ed2-4815-b30f-89aae5b3d79f service neutron] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:17.570869 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb18e4c-7ed2-4815-b30f-89aae5b3d79f service neutron] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:17.571179 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb18e4c-7ed2-4815-b30f-89aae5b3d79f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:17.579885 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb18e4c-7ed2-4815-b30f-89aae5b3d79f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:17.581306 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb18e4c-7ed2-4815-b30f-89aae5b3d79f service neutron] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:17.590475 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 541/1081] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:19.844803 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77792c-4232-4078-b866-05ff301f3386 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:19.845343 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77792c-4232-4078-b866-05ff301f3386 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:19.845343 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77792c-4232-4078-b866-05ff301f3386 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:19.846713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 541/1082] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:19.852159 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86378340-a1e5-400c-9c91-dd8736f0bcb0 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:19.852572 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86378340-a1e5-400c-9c91-dd8736f0bcb0 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:19.852703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86378340-a1e5-400c-9c91-dd8736f0bcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:19.871634 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-86378340-a1e5-400c-9c91-dd8736f0bcb0 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:19.872828 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-86378340-a1e5-400c-9c91-dd8736f0bcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:19.881099 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 542/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:20:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:20.218426 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77792c-4232-4078-b866-05ff301f3386 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:20.229171 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77792c-4232-4078-b866-05ff301f3386 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:20.232608 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc4290-9850-462d-b4dc-fa687ae4a710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:20.233186 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc4290-9850-462d-b4dc-fa687ae4a710 service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:20.233463 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc4290-9850-462d-b4dc-fa687ae4a710 service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:20.233732 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc4290-9850-462d-b4dc-fa687ae4a710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:20.242904 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc4290-9850-462d-b4dc-fa687ae4a710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:20.244376 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc4290-9850-462d-b4dc-fa687ae4a710 service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:20.254311 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 542/1084] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:22.470566 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23b065-ea6b-4497-a1af-88dd9a46c6a2 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:22.471274 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23b065-ea6b-4497-a1af-88dd9a46c6a2 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:22.471274 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23b065-ea6b-4497-a1af-88dd9a46c6a2 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:22.472575 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 543/1085] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:22.477931 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b1bfc-b649-43df-b2d1-ebf937cfaac5 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:22.478341 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b1bfc-b649-43df-b2d1-ebf937cfaac5 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:22.478449 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b1bfc-b649-43df-b2d1-ebf937cfaac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:22.508122 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-2a1b1bfc-b649-43df-b2d1-ebf937cfaac5 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:22.509324 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-2a1b1bfc-b649-43df-b2d1-ebf937cfaac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:22.518513 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 543/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:20:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:22.854596 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23b065-ea6b-4497-a1af-88dd9a46c6a2 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:22.865859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23b065-ea6b-4497-a1af-88dd9a46c6a2 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:22.869505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdcf76-80a0-4226-aa07-6e2d496892dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:22.870129 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdcf76-80a0-4226-aa07-6e2d496892dd service neutron] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:22.870396 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdcf76-80a0-4226-aa07-6e2d496892dd service neutron] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:22.870666 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdcf76-80a0-4226-aa07-6e2d496892dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:22.879566 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bdcf76-80a0-4226-aa07-6e2d496892dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:22.880995 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bdcf76-80a0-4226-aa07-6e2d496892dd service neutron] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:22.890169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 544/1087] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:32.501977 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=17 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:20:32.886211 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=17 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:20:46.726537 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2c9cb-4fcb-49ea-90b0-46ad8be3f605 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:46.727084 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2c9cb-4fcb-49ea-90b0-46ad8be3f605 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:46.727203 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2c9cb-4fcb-49ea-90b0-46ad8be3f605 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:46.728455 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 544/1088] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:46.733627 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975e825-63ea-4b80-9b57-1335f7ef8d4d None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:46.734022 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975e825-63ea-4b80-9b57-1335f7ef8d4d None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:46.734178 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975e825-63ea-4b80-9b57-1335f7ef8d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:46.753415 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-0975e825-63ea-4b80-9b57-1335f7ef8d4d None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:46.754598 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-0975e825-63ea-4b80-9b57-1335f7ef8d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:46.762239 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 545/1089] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:47.119089 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6756c-352a-4bee-9ca9-767019fff5f2 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:47.119375 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6756c-352a-4bee-9ca9-767019fff5f2 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:47.119653 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6756c-352a-4bee-9ca9-767019fff5f2 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:47.120985 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 545/1090] 10.222.0.42 () {54 vars in 967 bytes} [Wed Aug 24 00:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:47.126361 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ad051-d06d-49c1-8145-52deec0a223b None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:47.126642 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ad051-d06d-49c1-8145-52deec0a223b None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:47.126916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ad051-d06d-49c1-8145-52deec0a223b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:47.146193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-766ad051-d06d-49c1-8145-52deec0a223b None None] MFA Rules not processed for user `b588c52178934bce8cceff804a8f6e38`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:47.147408 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-766ad051-d06d-49c1-8145-52deec0a223b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:47.153854 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 546/1091] 10.222.0.42 () {58 vars in 1064 bytes} [Wed Aug 24 00:20:47 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:47.161496 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6756c-352a-4bee-9ca9-767019fff5f2 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:47.171989 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6756c-352a-4bee-9ca9-767019fff5f2 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:47.177395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166dc82-b2af-41b5-800b-4d70b8fb8aa7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b588c52178934bce8cceff804a8f6e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:47.177993 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166dc82-b2af-41b5-800b-4d70b8fb8aa7 service glance] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:47.178273 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166dc82-b2af-41b5-800b-4d70b8fb8aa7 service glance] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:47.178548 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166dc82-b2af-41b5-800b-4d70b8fb8aa7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:47.188026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166dc82-b2af-41b5-800b-4d70b8fb8aa7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:47.189451 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166dc82-b2af-41b5-800b-4d70b8fb8aa7 service glance] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:47.199734 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 546/1092] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:49.475938 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c584802-64a5-4ef5-8625-898c97c4c06f None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:49.476507 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c584802-64a5-4ef5-8625-898c97c4c06f None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:49.476507 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c584802-64a5-4ef5-8625-898c97c4c06f None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:49.477795 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 547/1093] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:49.482922 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276578c-8ea2-4f01-9464-1ffeffc4f00a None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:49.483377 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276578c-8ea2-4f01-9464-1ffeffc4f00a None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:49.483535 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276578c-8ea2-4f01-9464-1ffeffc4f00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:49.503304 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-d276578c-8ea2-4f01-9464-1ffeffc4f00a None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:49.504504 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-d276578c-8ea2-4f01-9464-1ffeffc4f00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:49.512207 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 547/1094] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:49.841140 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c584802-64a5-4ef5-8625-898c97c4c06f None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:49.853829 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c584802-64a5-4ef5-8625-898c97c4c06f None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:49.858241 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b082d7-f30b-4d29-8e3b-dde5a78a4d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:49.858834 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b082d7-f30b-4d29-8e3b-dde5a78a4d13 admin admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:49.859157 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b082d7-f30b-4d29-8e3b-dde5a78a4d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:49.859431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b082d7-f30b-4d29-8e3b-dde5a78a4d13 admin admin] PATH_INFO: `/v3/projects` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:49.860066 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b082d7-f30b-4d29-8e3b-dde5a78a4d13 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:49.861785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: WARNING py.warnings [None req-f8b082d7-f30b-4d29-8e3b-dde5a78a4d13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:20:49.861785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: warnings.warn(msg) Aug 24 00:20:49.861785 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: Aug 24 00:20:49.862951 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b082d7-f30b-4d29-8e3b-dde5a78a4d13 admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:49.881541 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 548/1095] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 00:20:49 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:20:52.075540 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6123dfe-e37b-4a9a-b7e9-f4d5202f613f None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:52.076137 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6123dfe-e37b-4a9a-b7e9-f4d5202f613f None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:52.076137 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6123dfe-e37b-4a9a-b7e9-f4d5202f613f None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:52.077465 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 548/1096] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:52.082571 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536f231-a2e4-4183-88bd-1fae89614d71 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:52.083034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536f231-a2e4-4183-88bd-1fae89614d71 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:52.083147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536f231-a2e4-4183-88bd-1fae89614d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:52.102882 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-2536f231-a2e4-4183-88bd-1fae89614d71 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:52.104090 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-2536f231-a2e4-4183-88bd-1fae89614d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:52.112812 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 549/1097] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:52.456810 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6123dfe-e37b-4a9a-b7e9-f4d5202f613f None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:52.470298 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6123dfe-e37b-4a9a-b7e9-f4d5202f613f None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:52.475908 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4dcace-34f8-4d15-a366-53bdeb2646a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:52.476496 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dcace-34f8-4d15-a366-53bdeb2646a0 service nova] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:52.476773 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dcace-34f8-4d15-a366-53bdeb2646a0 service nova] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:52.477041 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dcace-34f8-4d15-a366-53bdeb2646a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:52.485304 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4dcace-34f8-4d15-a366-53bdeb2646a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:52.486923 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4dcace-34f8-4d15-a366-53bdeb2646a0 service nova] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:52.496209 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 549/1098] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:54.846424 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecde43-3945-499d-a361-377aacfdebc0 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:54.847053 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecde43-3945-499d-a361-377aacfdebc0 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:54.847277 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecde43-3945-499d-a361-377aacfdebc0 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:54.848727 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 550/1099] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:20:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:54.854233 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0b369-d853-4886-89be-9fac3d75f1af None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:54.854698 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0b369-d853-4886-89be-9fac3d75f1af None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:54.854800 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0b369-d853-4886-89be-9fac3d75f1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:54.874660 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-8ef0b369-d853-4886-89be-9fac3d75f1af None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:54.876016 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-8ef0b369-d853-4886-89be-9fac3d75f1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:54.884820 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 550/1100] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:55.226293 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecde43-3945-499d-a361-377aacfdebc0 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:55.237946 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecde43-3945-499d-a361-377aacfdebc0 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:55.241455 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b67dc-b104-4c17-bbd3-7f05f1b01738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:55.242048 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b67dc-b104-4c17-bbd3-7f05f1b01738 service neutron] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:55.242330 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b67dc-b104-4c17-bbd3-7f05f1b01738 service neutron] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:55.242603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b67dc-b104-4c17-bbd3-7f05f1b01738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:55.251713 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b67dc-b104-4c17-bbd3-7f05f1b01738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:55.253756 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b67dc-b104-4c17-bbd3-7f05f1b01738 service neutron] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:55.263484 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 551/1101] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:20:57.513247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d0334-8b2a-483b-8ed0-d2848efb8ed1 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:57.513820 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d0334-8b2a-483b-8ed0-d2848efb8ed1 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:57.513820 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d0334-8b2a-483b-8ed0-d2848efb8ed1 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:57.515332 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 551/1102] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:20:57.520617 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e45c3b-b3c9-4002-976c-c716d40effbf None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:57.521022 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e45c3b-b3c9-4002-976c-c716d40effbf None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:57.521174 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e45c3b-b3c9-4002-976c-c716d40effbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:57.540123 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-d6e45c3b-b3c9-4002-976c-c716d40effbf None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:20:57.541334 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-d6e45c3b-b3c9-4002-976c-c716d40effbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:20:57.549066 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 552/1103] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:20:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:20:57.900550 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d0334-8b2a-483b-8ed0-d2848efb8ed1 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:20:57.912200 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d0334-8b2a-483b-8ed0-d2848efb8ed1 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:20:57.916043 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2d7bd-6f5b-47c1-9ba7-d4ed6a42fb5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:20:57.916643 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2d7bd-6f5b-47c1-9ba7-d4ed6a42fb5d service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:20:57.916919 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2d7bd-6f5b-47c1-9ba7-d4ed6a42fb5d service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:20:57.917187 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2d7bd-6f5b-47c1-9ba7-d4ed6a42fb5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:20:57.926925 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2d7bd-6f5b-47c1-9ba7-d4ed6a42fb5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:20:57.928384 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2d7bd-6f5b-47c1-9ba7-d4ed6a42fb5d service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:20:57.937970 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 552/1104] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:20:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:00.317833 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30a7af-fc9a-436c-98c1-207a593025c9 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:00.318392 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30a7af-fc9a-436c-98c1-207a593025c9 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:00.318392 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30a7af-fc9a-436c-98c1-207a593025c9 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:00.319771 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 553/1105] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:21:00.325180 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3fa3b-ba44-45a1-99c5-75c2c13954c0 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:00.325617 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3fa3b-ba44-45a1-99c5-75c2c13954c0 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:00.325729 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3fa3b-ba44-45a1-99c5-75c2c13954c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:00.344835 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-0ba3fa3b-ba44-45a1-99c5-75c2c13954c0 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:00.346024 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-0ba3fa3b-ba44-45a1-99c5-75c2c13954c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:00.353968 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 553/1106] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:21:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:21:00.710457 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30a7af-fc9a-436c-98c1-207a593025c9 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:00.721088 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30a7af-fc9a-436c-98c1-207a593025c9 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:00.724556 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a8d33-fbf7-45cf-a408-dfac9689e5ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:00.725142 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a8d33-fbf7-45cf-a408-dfac9689e5ce service neutron] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:00.725429 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a8d33-fbf7-45cf-a408-dfac9689e5ce service neutron] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:00.725774 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a8d33-fbf7-45cf-a408-dfac9689e5ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:00.734672 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a8d33-fbf7-45cf-a408-dfac9689e5ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:00.736149 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a8d33-fbf7-45cf-a408-dfac9689e5ce service neutron] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:00.746288 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 554/1107] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:03.095207 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0de277-fbed-4ec2-8349-db94e51903a6 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:03.095713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0de277-fbed-4ec2-8349-db94e51903a6 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:03.095713 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0de277-fbed-4ec2-8349-db94e51903a6 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:03.097140 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 554/1108] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 00:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:21:03.102485 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690c1c7-7aa1-4d1f-8a84-fa852295bacd None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:03.102876 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690c1c7-7aa1-4d1f-8a84-fa852295bacd None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:03.103103 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690c1c7-7aa1-4d1f-8a84-fa852295bacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:03.125802 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-0690c1c7-7aa1-4d1f-8a84-fa852295bacd None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:21:03.127018 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-0690c1c7-7aa1-4d1f-8a84-fa852295bacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:21:03.135439 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 555/1109] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 00:21:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:21:03.488726 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0de277-fbed-4ec2-8349-db94e51903a6 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:21:03.499521 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0de277-fbed-4ec2-8349-db94e51903a6 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:21:03.503689 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b7949-4b06-4279-a5f2-1744e90e9f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:21:03.504343 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b7949-4b06-4279-a5f2-1744e90e9f58 service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:21:03.504623 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b7949-4b06-4279-a5f2-1744e90e9f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:21:03.504897 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b7949-4b06-4279-a5f2-1744e90e9f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:21:03.514251 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b7949-4b06-4279-a5f2-1744e90e9f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:21:03.515735 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b7949-4b06-4279-a5f2-1744e90e9f58 service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:21:03.525766 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 555/1110] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:21:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:21:13.121207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=33 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:21:13.521501 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=33 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:22:16.171864 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d349d-a312-4a7e-a23a-5f03cc5ea2d9 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:16.173044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d349d-a312-4a7e-a23a-5f03cc5ea2d9 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:16.173044 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d349d-a312-4a7e-a23a-5f03cc5ea2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:16.193230 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-f63d349d-a312-4a7e-a23a-5f03cc5ea2d9 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:22:16.194427 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-f63d349d-a312-4a7e-a23a-5f03cc5ea2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:22:16.203519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 556/1111] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:22:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:22:16.211886 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c46a9-c49f-4950-87e9-e24cfabde11b None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:16.212422 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c46a9-c49f-4950-87e9-e24cfabde11b None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:16.212526 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c46a9-c49f-4950-87e9-e24cfabde11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:16.231639 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-5a5c46a9-c49f-4950-87e9-e24cfabde11b None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:22:16.232973 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-5a5c46a9-c49f-4950-87e9-e24cfabde11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:22:16.241204 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 556/1112] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:22:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:22:16.246017 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d349d-a312-4a7e-a23a-5f03cc5ea2d9 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:22:16.256609 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d349d-a312-4a7e-a23a-5f03cc5ea2d9 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:22:16.261328 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8f1d4-7975-4ac9-80a8-743951928cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:22:16.261922 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8f1d4-7975-4ac9-80a8-743951928cfc admin admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:16.262201 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8f1d4-7975-4ac9-80a8-743951928cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:16.262470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8f1d4-7975-4ac9-80a8-743951928cfc admin admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:16.263142 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8f1d4-7975-4ac9-80a8-743951928cfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:22:16.263447 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8f1d4-7975-4ac9-80a8-743951928cfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:22:16.264464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: WARNING py.warnings [None req-c6e8f1d4-7975-4ac9-80a8-743951928cfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:22:16.264464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: warnings.warn(msg) Aug 24 00:22:16.264464 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: Aug 24 00:22:16.265359 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8f1d4-7975-4ac9-80a8-743951928cfc admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:22:16.277058 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 557/1113] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 00:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:22:16.285610 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c46a9-c49f-4950-87e9-e24cfabde11b None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:22:16.294890 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c46a9-c49f-4950-87e9-e24cfabde11b None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:22:16.300143 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7f14f-ea3f-4d97-9f8b-5b214af3a459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:22:16.300743 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7f14f-ea3f-4d97-9f8b-5b214af3a459 admin admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:16.301020 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7f14f-ea3f-4d97-9f8b-5b214af3a459 admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:16.301289 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7f14f-ea3f-4d97-9f8b-5b214af3a459 admin admin] PATH_INFO: `/v3/projects` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:16.301924 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7f14f-ea3f-4d97-9f8b-5b214af3a459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:22:16.303735 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: WARNING py.warnings [None req-41e7f14f-ea3f-4d97-9f8b-5b214af3a459 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:22:16.303735 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: warnings.warn(msg) Aug 24 00:22:16.303735 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: Aug 24 00:22:16.304938 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7f14f-ea3f-4d97-9f8b-5b214af3a459 admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:22:16.336411 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 557/1114] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 00:22:16 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:22:16.340631 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8f1d4-7975-4ac9-80a8-743951928cfc admin admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:22:16.350547 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8f1d4-7975-4ac9-80a8-743951928cfc admin admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:22:16.407003 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18cbfe-d51a-47ca-8410-334600937f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:22:16.407626 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18cbfe-d51a-47ca-8410-334600937f24 admin admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:16.407906 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18cbfe-d51a-47ca-8410-334600937f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:16.408203 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18cbfe-d51a-47ca-8410-334600937f24 admin admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:16.408816 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18cbfe-d51a-47ca-8410-334600937f24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:22:16.409833 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: WARNING py.warnings [None req-9f18cbfe-d51a-47ca-8410-334600937f24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:22:16.409833 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: warnings.warn(msg) Aug 24 00:22:16.409833 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: Aug 24 00:22:16.411082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18cbfe-d51a-47ca-8410-334600937f24 admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:22:16.433431 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 558/1115] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 00:22:16 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:22:16.437540 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7f14f-ea3f-4d97-9f8b-5b214af3a459 admin admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:22:16.448370 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7f14f-ea3f-4d97-9f8b-5b214af3a459 admin admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:22:16.452840 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c160c-2e14-44c7-a716-3c41aca28a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:22:16.453430 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c160c-2e14-44c7-a716-3c41aca28a8f admin admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:16.453708 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c160c-2e14-44c7-a716-3c41aca28a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:16.453986 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c160c-2e14-44c7-a716-3c41aca28a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:16.454625 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c160c-2e14-44c7-a716-3c41aca28a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:22:16.455680 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: WARNING py.warnings [None req-1a1c160c-2e14-44c7-a716-3c41aca28a8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:22:16.455680 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: warnings.warn(msg) Aug 24 00:22:16.455680 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: Aug 24 00:22:16.456574 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c160c-2e14-44c7-a716-3c41aca28a8f admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:22:16.469095 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 558/1116] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 00:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:22:16.473227 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18cbfe-d51a-47ca-8410-334600937f24 admin admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:22:16.483168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18cbfe-d51a-47ca-8410-334600937f24 admin admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:22:16.488556 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a1c57-91dd-4cc9-9342-341f90ec2927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:22:16.489166 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a1c57-91dd-4cc9-9342-341f90ec2927 admin admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:16.489427 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a1c57-91dd-4cc9-9342-341f90ec2927 admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:16.489698 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a1c57-91dd-4cc9-9342-341f90ec2927 admin admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:16.490334 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a1c57-91dd-4cc9-9342-341f90ec2927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:22:16.491384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: WARNING py.warnings [None req-749a1c57-91dd-4cc9-9342-341f90ec2927 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:22:16.491384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: warnings.warn(msg) Aug 24 00:22:16.491384 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: Aug 24 00:22:16.492279 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a1c57-91dd-4cc9-9342-341f90ec2927 admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:22:16.505885 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 559/1117] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 00:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:22:16.509981 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c160c-2e14-44c7-a716-3c41aca28a8f admin admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:22:16.522595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c160c-2e14-44c7-a716-3c41aca28a8f admin admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:22:16.527300 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97e613-0fad-4f8e-b95d-0a5fb3d5ab42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:22:16.527983 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97e613-0fad-4f8e-b95d-0a5fb3d5ab42 admin admin] REQUEST_METHOD: `PUT` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:16.528292 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97e613-0fad-4f8e-b95d-0a5fb3d5ab42 admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:16.528569 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97e613-0fad-4f8e-b95d-0a5fb3d5ab42 admin admin] PATH_INFO: `/v3/projects/937f402d08234a2aa5f179d85d66e054/users/a8e655ce2810451896ffaf31738b796b/roles/3fe3a1eb546b456aa3c8bce846a8d37f` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:16.543743 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97e613-0fad-4f8e-b95d-0a5fb3d5ab42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=937f402d08234a2aa5f179d85d66e054, user_id=a8e655ce2810451896ffaf31738b796b, role_id=3fe3a1eb546b456aa3c8bce846a8d37f)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:22:16.544775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: WARNING py.warnings [None req-df97e613-0fad-4f8e-b95d-0a5fb3d5ab42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:22:16.544775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: warnings.warn(msg) Aug 24 00:22:16.544775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: Aug 24 00:22:16.546753 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97e613-0fad-4f8e-b95d-0a5fb3d5ab42 admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:22:16.561532 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 559/1118] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 00:22:16 2022] PUT /identity/v3/projects/937f402d08234a2aa5f179d85d66e054/users/a8e655ce2810451896ffaf31738b796b/roles/3fe3a1eb546b456aa3c8bce846a8d37f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:22:16.574305 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc55da-b393-4c19-bb39-83b41a1d50b0 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:16.574595 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc55da-b393-4c19-bb39-83b41a1d50b0 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:16.574869 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc55da-b393-4c19-bb39-83b41a1d50b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:16.603592 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-acfc55da-b393-4c19-bb39-83b41a1d50b0 None None] MFA Rules not processed for user `a8e655ce2810451896ffaf31738b796b`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:22:16.604784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-acfc55da-b393-4c19-bb39-83b41a1d50b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:22:16.667169 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 560/1119] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:22:16 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:22:16.681499 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb42e8-4d00-4c14-8e5c-9fe9dc8d07ca None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:16.681784 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb42e8-4d00-4c14-8e5c-9fe9dc8d07ca None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:16.682058 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb42e8-4d00-4c14-8e5c-9fe9dc8d07ca None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:16.683487 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 560/1120] 10.222.0.42 () {54 vars in 964 bytes} [Wed Aug 24 00:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:22:16.688225 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48c94b-ead7-40ee-9a1a-c3b8e449e1d9 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:16.688516 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48c94b-ead7-40ee-9a1a-c3b8e449e1d9 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:16.688794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48c94b-ead7-40ee-9a1a-c3b8e449e1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:16.707805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-5d48c94b-ead7-40ee-9a1a-c3b8e449e1d9 None None] MFA Rules not processed for user `c43d7aa4ecfc4a598bbaa4f4fc4e4590`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:22:16.709017 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-5d48c94b-ead7-40ee-9a1a-c3b8e449e1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:22:16.754742 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:22:16.762778 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 561/1121] 10.222.0.42 () {58 vars in 1061 bytes} [Wed Aug 24 00:22:16 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:22:16.770525 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb42e8-4d00-4c14-8e5c-9fe9dc8d07ca None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:22:16.781271 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb42e8-4d00-4c14-8e5c-9fe9dc8d07ca None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:22:16.785247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1f9b8-2342-439f-8c7d-32e27513b8ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43d7aa4ecfc4a598bbaa4f4fc4e4590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:22:16.785838 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1f9b8-2342-439f-8c7d-32e27513b8ef service cinder] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:16.786117 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1f9b8-2342-439f-8c7d-32e27513b8ef service cinder] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:16.786386 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1f9b8-2342-439f-8c7d-32e27513b8ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:16.795098 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1f9b8-2342-439f-8c7d-32e27513b8ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:22:16.796540 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1f9b8-2342-439f-8c7d-32e27513b8ef service cinder] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:22:16.806125 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 561/1122] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:22:16 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:22:16.845292 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceb7cb-6653-4905-b8da-0ef64a4241f0 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:16.845577 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceb7cb-6653-4905-b8da-0ef64a4241f0 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:16.845849 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceb7cb-6653-4905-b8da-0ef64a4241f0 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:16.847229 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 562/1123] 10.222.0.42 () {52 vars in 830 bytes} [Wed Aug 24 00:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:22:16.850749 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1f9b8-2342-439f-8c7d-32e27513b8ef service cinder] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:22:16.917437 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1f9b8-2342-439f-8c7d-32e27513b8ef service cinder] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:22:16.921973 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e36b5b-9fa8-4567-90e1-24f890f5fe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:22:16.923202 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e36b5b-9fa8-4567-90e1-24f890f5fe11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:16.923483 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e36b5b-9fa8-4567-90e1-24f890f5fe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:16.923753 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e36b5b-9fa8-4567-90e1-24f890f5fe11 admin admin] PATH_INFO: `/v3/users/a8e655ce2810451896ffaf31738b796b` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:16.924911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e36b5b-9fa8-4567-90e1-24f890f5fe11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e655ce2810451896ffaf31738b796b)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:22:16.925930 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: WARNING py.warnings [None req-31e36b5b-9fa8-4567-90e1-24f890f5fe11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:22:16.925930 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: warnings.warn(msg) Aug 24 00:22:16.925930 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: Aug 24 00:22:16.927206 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e36b5b-9fa8-4567-90e1-24f890f5fe11 admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:22:16.999413 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-31e36b5b-9fa8-4567-90e1-24f890f5fe11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e655ce2810451896ffaf31738b796b'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:22:16.999977 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-31e36b5b-9fa8-4567-90e1-24f890f5fe11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e655ce2810451896ffaf31738b796b'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:22:17.010564 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-31e36b5b-9fa8-4567-90e1-24f890f5fe11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e655ce2810451896ffaf31738b796b'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:22:17.035395 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-31e36b5b-9fa8-4567-90e1-24f890f5fe11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e655ce2810451896ffaf31738b796b'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:22:17.049632 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-31e36b5b-9fa8-4567-90e1-24f890f5fe11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e655ce2810451896ffaf31738b796b'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:22:17.058633 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 562/1124] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 00:22:16 2022] DELETE /identity/v3/users/a8e655ce2810451896ffaf31738b796b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:22:17.064465 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a3fb4-9ec6-428a-8f87-85c91cf38fa3 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:17.064832 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a3fb4-9ec6-428a-8f87-85c91cf38fa3 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:17.065314 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a3fb4-9ec6-428a-8f87-85c91cf38fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:17.088116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-1b3a3fb4-9ec6-428a-8f87-85c91cf38fa3 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:22:17.089558 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-1b3a3fb4-9ec6-428a-8f87-85c91cf38fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:22:17.148063 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 563/1125] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:22:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:22:17.158677 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e36b5b-9fa8-4567-90e1-24f890f5fe11 admin admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:22:17.160135 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-31e36b5b-9fa8-4567-90e1-24f890f5fe11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:22:17.165691 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:22:17.222506 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e36b5b-9fa8-4567-90e1-24f890f5fe11 admin admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:22:17.226418 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c2be2-703d-4a3f-b56f-b6fcc067319c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:22:17.227094 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c2be2-703d-4a3f-b56f-b6fcc067319c service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:17.227379 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c2be2-703d-4a3f-b56f-b6fcc067319c service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:17.227653 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c2be2-703d-4a3f-b56f-b6fcc067319c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:17.237037 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c2be2-703d-4a3f-b56f-b6fcc067319c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:22:17.238494 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c2be2-703d-4a3f-b56f-b6fcc067319c service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:22:17.248174 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 563/1126] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:22:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:22:17.611750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a3fb4-9ec6-428a-8f87-85c91cf38fa3 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:22:17.613608 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-1b3a3fb4-9ec6-428a-8f87-85c91cf38fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:22:17.626217 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a3fb4-9ec6-428a-8f87-85c91cf38fa3 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:22:17.631114 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37fd8f-dbd6-4b5a-992b-dd7ab3ea0ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:22:17.631756 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37fd8f-dbd6-4b5a-992b-dd7ab3ea0ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:22:17.632039 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37fd8f-dbd6-4b5a-992b-dd7ab3ea0ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:22:17.632310 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37fd8f-dbd6-4b5a-992b-dd7ab3ea0ab5 admin admin] PATH_INFO: `/v3/projects/937f402d08234a2aa5f179d85d66e054` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:22:17.633470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37fd8f-dbd6-4b5a-992b-dd7ab3ea0ab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=937f402d08234a2aa5f179d85d66e054)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:22:17.634519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: WARNING py.warnings [None req-6a37fd8f-dbd6-4b5a-992b-dd7ab3ea0ab5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:22:17.634519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: warnings.warn(msg) Aug 24 00:22:17.634519 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: Aug 24 00:22:17.635784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37fd8f-dbd6-4b5a-992b-dd7ab3ea0ab5 admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:22:17.700712 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-6a37fd8f-dbd6-4b5a-992b-dd7ab3ea0ab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '937f402d08234a2aa5f179d85d66e054', 'request_id': 'req-6a37fd8f-dbd6-4b5a-992b-dd7ab3ea0ab5'} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:22:17.713838 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-6a37fd8f-dbd6-4b5a-992b-dd7ab3ea0ab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '937f402d08234a2aa5f179d85d66e054', 'request_id': 'req-6a37fd8f-dbd6-4b5a-992b-dd7ab3ea0ab5'} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:22:17.720115 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-6a37fd8f-dbd6-4b5a-992b-dd7ab3ea0ab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '937f402d08234a2aa5f179d85d66e054', 'request_id': 'req-6a37fd8f-dbd6-4b5a-992b-dd7ab3ea0ab5'} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:22:17.735583 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-6a37fd8f-dbd6-4b5a-992b-dd7ab3ea0ab5 admin admin] The token cache is being invalidate because project 937f402d08234a2aa5f179d85d66e054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 00:22:17.735871 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-6a37fd8f-dbd6-4b5a-992b-dd7ab3ea0ab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:22:17.736496 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-6a37fd8f-dbd6-4b5a-992b-dd7ab3ea0ab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:22:17.738091 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 564/1127] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 00:22:17 2022] DELETE /identity/v3/projects/937f402d08234a2aa5f179d85d66e054 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:22:27.244136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=25 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:22:27.732040 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:23:39.818169 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c05b3-dfed-46cb-9977-7f2b8775ef8e None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:39.818680 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c05b3-dfed-46cb-9977-7f2b8775ef8e None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:39.818791 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c05b3-dfed-46cb-9977-7f2b8775ef8e None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:39.820192 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 564/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 00:23:39.824994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9179299-d760-4407-9dff-ccf3eb5b21db None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:39.825416 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9179299-d760-4407-9dff-ccf3eb5b21db None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:39.825520 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9179299-d760-4407-9dff-ccf3eb5b21db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:39.895791 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-c9179299-d760-4407-9dff-ccf3eb5b21db None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:23:39.896988 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-c9179299-d760-4407-9dff-ccf3eb5b21db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:23:39.994468 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 565/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:23:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:23:40.153624 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c05b3-dfed-46cb-9977-7f2b8775ef8e None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:23:40.155366 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-698c05b3-dfed-46cb-9977-7f2b8775ef8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:23:40.243467 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c05b3-dfed-46cb-9977-7f2b8775ef8e None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:23:40.248355 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c07c31-844e-4ed5-86ad-3d7fd97d6d37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:23:40.248953 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c07c31-844e-4ed5-86ad-3d7fd97d6d37 service nova] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:40.249228 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c07c31-844e-4ed5-86ad-3d7fd97d6d37 service nova] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:40.249496 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c07c31-844e-4ed5-86ad-3d7fd97d6d37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:40.257454 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c07c31-844e-4ed5-86ad-3d7fd97d6d37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:23:40.259074 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c07c31-844e-4ed5-86ad-3d7fd97d6d37 service nova] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:23:40.268502 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 565/1130] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:23:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:23:41.103310 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0f036-4b36-4d1d-a845-3ae62c3be93d None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:41.103875 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0f036-4b36-4d1d-a845-3ae62c3be93d None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:41.103875 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0f036-4b36-4d1d-a845-3ae62c3be93d None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:41.105207 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 566/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:23:41.109974 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0541508-0e31-4a82-8eab-1028c48ec136 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:41.110399 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0541508-0e31-4a82-8eab-1028c48ec136 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:41.110532 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0541508-0e31-4a82-8eab-1028c48ec136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:41.130709 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-d0541508-0e31-4a82-8eab-1028c48ec136 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:23:41.131872 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-d0541508-0e31-4a82-8eab-1028c48ec136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:23:41.139723 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 566/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:23:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:23:41.297008 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0f036-4b36-4d1d-a845-3ae62c3be93d None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:23:41.311188 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0f036-4b36-4d1d-a845-3ae62c3be93d None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:23:41.316768 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe103804-0aa3-498a-97a4-c145a7003c9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:23:41.317359 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe103804-0aa3-498a-97a4-c145a7003c9c service nova] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:41.317643 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe103804-0aa3-498a-97a4-c145a7003c9c service nova] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:41.317917 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe103804-0aa3-498a-97a4-c145a7003c9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:41.326010 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe103804-0aa3-498a-97a4-c145a7003c9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:23:41.327671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe103804-0aa3-498a-97a4-c145a7003c9c service nova] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:23:41.337024 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 567/1133] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:23:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:23:46.136683 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4845f7d-77e4-41ae-b762-ea1e75afe6c2 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:46.137247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4845f7d-77e4-41ae-b762-ea1e75afe6c2 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:46.137247 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4845f7d-77e4-41ae-b762-ea1e75afe6c2 None None] PATH_INFO: `/v3` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:46.138510 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 567/1134] 10.222.0.73 () {54 vars in 925 bytes} [Wed Aug 24 00:23:46 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:23:46.144329 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295a8e9-8a3c-4324-b4e7-b21ee809b54f None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:46.144732 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295a8e9-8a3c-4324-b4e7-b21ee809b54f None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:46.144876 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295a8e9-8a3c-4324-b4e7-b21ee809b54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:46.175145 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-1295a8e9-8a3c-4324-b4e7-b21ee809b54f None None] MFA Rules not processed for user `ebffbdf5a1234167903a9fd4490bb174`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:23:46.176347 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-1295a8e9-8a3c-4324-b4e7-b21ee809b54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:23:46.228565 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:23:46.239613 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 568/1135] 10.222.0.73 () {58 vars in 1015 bytes} [Wed Aug 24 00:23:46 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:23:50.382882 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe3929-67f0-42c5-9c28-8898c5dbe0f1 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:50.383452 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe3929-67f0-42c5-9c28-8898c5dbe0f1 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:50.383452 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe3929-67f0-42c5-9c28-8898c5dbe0f1 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:50.384788 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 568/1136] 10.222.0.42 () {54 vars in 961 bytes} [Wed Aug 24 00:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:23:50.389804 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b654e-b780-4d02-a2ab-879509b2c884 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:50.390189 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b654e-b780-4d02-a2ab-879509b2c884 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:50.390356 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b654e-b780-4d02-a2ab-879509b2c884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:50.410506 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-ad8b654e-b780-4d02-a2ab-879509b2c884 None None] MFA Rules not processed for user `ebffbdf5a1234167903a9fd4490bb174`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:23:50.411743 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-ad8b654e-b780-4d02-a2ab-879509b2c884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:23:50.420181 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 569/1137] 10.222.0.42 () {58 vars in 1058 bytes} [Wed Aug 24 00:23:50 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:23:50.427336 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe3929-67f0-42c5-9c28-8898c5dbe0f1 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:23:50.440747 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe3929-67f0-42c5-9c28-8898c5dbe0f1 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:23:50.445813 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a2430-ce06-4171-9ad0-21b00b57e476 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebffbdf5a1234167903a9fd4490bb174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:23:50.446496 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a2430-ce06-4171-9ad0-21b00b57e476 service placement] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:50.446780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a2430-ce06-4171-9ad0-21b00b57e476 service placement] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:50.447091 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a2430-ce06-4171-9ad0-21b00b57e476 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:50.456371 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a2430-ce06-4171-9ad0-21b00b57e476 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:23:50.457937 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a2430-ce06-4171-9ad0-21b00b57e476 service placement] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:23:50.467961 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 569/1138] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:23:50 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:23:52.551299 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab8d95-8aac-4c27-a74a-acc651cb08db None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:52.551784 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab8d95-8aac-4c27-a74a-acc651cb08db None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:52.551889 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab8d95-8aac-4c27-a74a-acc651cb08db None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:52.553170 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 570/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:23:52.558301 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51f00c-2063-4c4d-860f-1a8234b14584 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:52.558687 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51f00c-2063-4c4d-860f-1a8234b14584 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:52.558851 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51f00c-2063-4c4d-860f-1a8234b14584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:52.577967 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-4d51f00c-2063-4c4d-860f-1a8234b14584 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:23:52.579184 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-4d51f00c-2063-4c4d-860f-1a8234b14584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:23:52.587514 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 570/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:23:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:23:52.746125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab8d95-8aac-4c27-a74a-acc651cb08db None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:23:52.760395 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab8d95-8aac-4c27-a74a-acc651cb08db None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:23:52.765241 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcb139-054a-4897-aa6d-72a5637297be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:23:52.765832 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcb139-054a-4897-aa6d-72a5637297be service nova] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:52.766108 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcb139-054a-4897-aa6d-72a5637297be service nova] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:52.766379 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcb139-054a-4897-aa6d-72a5637297be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:52.774557 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcb139-054a-4897-aa6d-72a5637297be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:23:52.776115 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcb139-054a-4897-aa6d-72a5637297be service nova] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:23:52.785596 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 571/1141] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:23:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:23:53.618699 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008a2c4-cdde-4bc7-a9ca-e33aa3fcaf9e None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:53.619258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008a2c4-cdde-4bc7-a9ca-e33aa3fcaf9e None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:53.619258 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008a2c4-cdde-4bc7-a9ca-e33aa3fcaf9e None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:53.620648 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 571/1142] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 00:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:23:53.625707 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea72024-62fa-4aea-b460-ad4a19190816 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:53.626174 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea72024-62fa-4aea-b460-ad4a19190816 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:53.626277 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea72024-62fa-4aea-b460-ad4a19190816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:53.649145 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-1ea72024-62fa-4aea-b460-ad4a19190816 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:23:53.650436 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-1ea72024-62fa-4aea-b460-ad4a19190816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:23:53.658423 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 572/1143] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 00:23:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:23:53.814252 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008a2c4-cdde-4bc7-a9ca-e33aa3fcaf9e None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:23:53.828254 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008a2c4-cdde-4bc7-a9ca-e33aa3fcaf9e None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:23:53.833953 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634565bd-18be-419b-8d84-ca5027c780ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:23:53.834580 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634565bd-18be-419b-8d84-ca5027c780ae service nova] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:53.834862 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634565bd-18be-419b-8d84-ca5027c780ae service nova] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:53.835173 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634565bd-18be-419b-8d84-ca5027c780ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:53.843745 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634565bd-18be-419b-8d84-ca5027c780ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:23:53.845382 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634565bd-18be-419b-8d84-ca5027c780ae service nova] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:23:53.855016 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 572/1144] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:23:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:23:57.992435 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec84353-843b-4e2c-bb69-a704fe088fb9 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:57.993020 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec84353-843b-4e2c-bb69-a704fe088fb9 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:57.993020 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec84353-843b-4e2c-bb69-a704fe088fb9 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:57.994256 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 573/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:23:57.999420 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341e2c7-1cdf-41e8-9f05-54d285738fde None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:57.999850 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341e2c7-1cdf-41e8-9f05-54d285738fde None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:57.999950 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341e2c7-1cdf-41e8-9f05-54d285738fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:58.019394 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-c341e2c7-1cdf-41e8-9f05-54d285738fde None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:23:58.020594 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-c341e2c7-1cdf-41e8-9f05-54d285738fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:23:58.028314 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 573/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:23:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:23:58.373979 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec84353-843b-4e2c-bb69-a704fe088fb9 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:23:58.375708 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-3ec84353-843b-4e2c-bb69-a704fe088fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:23:58.434131 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec84353-843b-4e2c-bb69-a704fe088fb9 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:23:58.437585 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b25c82-3b67-4211-9d80-d10a85de2780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:23:58.438184 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b25c82-3b67-4211-9d80-d10a85de2780 service neutron] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:23:58.438465 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b25c82-3b67-4211-9d80-d10a85de2780 service neutron] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:23:58.438740 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b25c82-3b67-4211-9d80-d10a85de2780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:23:58.448116 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b25c82-3b67-4211-9d80-d10a85de2780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:23:58.449552 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b25c82-3b67-4211-9d80-d10a85de2780 service neutron] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:23:58.459532 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 574/1147] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:23:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:24:00.629083 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb7f05-0db4-4825-85f9-1b9b1e2e0cd4 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:24:00.629652 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb7f05-0db4-4825-85f9-1b9b1e2e0cd4 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:24:00.629652 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb7f05-0db4-4825-85f9-1b9b1e2e0cd4 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:24:00.630974 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 574/1148] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:24:00.636142 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170c50d-07d3-44f1-9b93-d5ed872d3de5 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:24:00.636610 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170c50d-07d3-44f1-9b93-d5ed872d3de5 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:24:00.636725 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170c50d-07d3-44f1-9b93-d5ed872d3de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:24:00.656498 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-5170c50d-07d3-44f1-9b93-d5ed872d3de5 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:24:00.657757 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-5170c50d-07d3-44f1-9b93-d5ed872d3de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:24:00.665420 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 575/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:24:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:24:01.011797 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb7f05-0db4-4825-85f9-1b9b1e2e0cd4 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:24:01.022434 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb7f05-0db4-4825-85f9-1b9b1e2e0cd4 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:24:01.025902 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b709305-3654-4196-a638-dd1018f721fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:24:01.026485 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b709305-3654-4196-a638-dd1018f721fb service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:24:01.026763 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b709305-3654-4196-a638-dd1018f721fb service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:24:01.027079 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b709305-3654-4196-a638-dd1018f721fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:24:01.035897 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b709305-3654-4196-a638-dd1018f721fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:24:01.037322 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b709305-3654-4196-a638-dd1018f721fb service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:24:01.046522 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 575/1150] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:24:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:24:04.802349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa1e19-dcca-4d65-a19d-974e5db66210 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:24:04.802898 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa1e19-dcca-4d65-a19d-974e5db66210 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:24:04.802898 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa1e19-dcca-4d65-a19d-974e5db66210 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:24:04.804507 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 576/1151] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:24:04.809787 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddf9d2-26f2-4b8b-8230-f7f42e4482a4 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:24:04.810214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddf9d2-26f2-4b8b-8230-f7f42e4482a4 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:24:04.810319 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddf9d2-26f2-4b8b-8230-f7f42e4482a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:24:04.830264 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-b5ddf9d2-26f2-4b8b-8230-f7f42e4482a4 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:24:04.831503 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-b5ddf9d2-26f2-4b8b-8230-f7f42e4482a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:24:04.839259 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 576/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:24:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:24:05.415866 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa1e19-dcca-4d65-a19d-974e5db66210 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:24:05.417542 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-27aa1e19-dcca-4d65-a19d-974e5db66210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:24:05.474658 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa1e19-dcca-4d65-a19d-974e5db66210 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:24:05.478147 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2514a-b694-4ead-ad17-1548b12ad128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43d7aa4ecfc4a598bbaa4f4fc4e4590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:24:05.478745 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2514a-b694-4ead-ad17-1548b12ad128 service cinder] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:24:05.479052 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2514a-b694-4ead-ad17-1548b12ad128 service cinder] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:24:05.479335 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2514a-b694-4ead-ad17-1548b12ad128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:24:05.488155 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2514a-b694-4ead-ad17-1548b12ad128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:24:05.489588 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2514a-b694-4ead-ad17-1548b12ad128 service cinder] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:24:05.498815 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 577/1153] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:24:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:24:07.691446 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab4bfc-957b-4737-87a5-894636d198de None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:24:07.691978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab4bfc-957b-4737-87a5-894636d198de None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:24:07.691978 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab4bfc-957b-4737-87a5-894636d198de None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:24:07.693325 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 577/1154] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 00:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:24:07.698498 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765d7a1-868c-4c23-9001-22ed9b94447b None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:24:07.698902 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765d7a1-868c-4c23-9001-22ed9b94447b None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:24:07.699075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765d7a1-868c-4c23-9001-22ed9b94447b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:24:07.718904 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-7765d7a1-868c-4c23-9001-22ed9b94447b None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:24:07.720146 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-7765d7a1-868c-4c23-9001-22ed9b94447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:24:07.728353 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 578/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 00:24:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:24:08.299572 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab4bfc-957b-4737-87a5-894636d198de None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:24:08.301251 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-84ab4bfc-957b-4737-87a5-894636d198de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:24:08.308951 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=70 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:24:08.314732 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab4bfc-957b-4737-87a5-894636d198de None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:24:08.318182 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be816af6-7ea3-4983-a83e-f111784542f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43d7aa4ecfc4a598bbaa4f4fc4e4590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:24:08.318764 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be816af6-7ea3-4983-a83e-f111784542f8 service cinder] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:24:08.319056 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be816af6-7ea3-4983-a83e-f111784542f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:24:08.319326 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be816af6-7ea3-4983-a83e-f111784542f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:24:08.327869 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be816af6-7ea3-4983-a83e-f111784542f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:24:08.330113 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be816af6-7ea3-4983-a83e-f111784542f8 service cinder] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:24:08.339041 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 578/1156] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:24:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:24:17.714102 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=70 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:24:18.335017 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=5 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:25:21.472883 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0b83e-2141-4858-a172-bc05808bab1e None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:21.474103 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0b83e-2141-4858-a172-bc05808bab1e None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:21.474103 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0b83e-2141-4858-a172-bc05808bab1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:21.492270 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d6a2a-f922-46f7-aea0-6bc70a083509 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:21.492960 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d6a2a-f922-46f7-aea0-6bc70a083509 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:21.492960 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d6a2a-f922-46f7-aea0-6bc70a083509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:21.494021 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-99d0b83e-2141-4858-a172-bc05808bab1e None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:21.502157 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-99d0b83e-2141-4858-a172-bc05808bab1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:21.510440 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 579/1157] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:25:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:25:21.518406 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4598c1-9150-4181-a4d9-934bc242824e None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:21.518592 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-923d6a2a-f922-46f7-aea0-6bc70a083509 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:21.518693 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4598c1-9150-4181-a4d9-934bc242824e None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:21.519085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4598c1-9150-4181-a4d9-934bc242824e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:21.519692 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-923d6a2a-f922-46f7-aea0-6bc70a083509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:21.528796 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 579/1158] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:25:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:25:21.537355 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf5e88-48a6-423e-8672-9e9725263cb1 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:21.537645 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf5e88-48a6-423e-8672-9e9725263cb1 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:21.537921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf5e88-48a6-423e-8672-9e9725263cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:21.538965 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-9b4598c1-9150-4181-a4d9-934bc242824e None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:21.540185 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-9b4598c1-9150-4181-a4d9-934bc242824e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:21.548054 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 580/1159] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:25:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:25:21.554086 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4598c1-9150-4181-a4d9-934bc242824e None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:21.557231 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-0adf5e88-48a6-423e-8672-9e9725263cb1 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:21.558416 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-0adf5e88-48a6-423e-8672-9e9725263cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:21.562931 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4598c1-9150-4181-a4d9-934bc242824e None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:21.566486 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 580/1160] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:25:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:25:21.568151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29ae8e-3682-4f25-9482-455de4f56c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:21.568733 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29ae8e-3682-4f25-9482-455de4f56c57 admin admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:21.569010 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29ae8e-3682-4f25-9482-455de4f56c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:21.569285 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29ae8e-3682-4f25-9482-455de4f56c57 admin admin] PATH_INFO: `/v3/domains` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:21.569921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29ae8e-3682-4f25-9482-455de4f56c57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:25:21.570234 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29ae8e-3682-4f25-9482-455de4f56c57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:21.571214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf5e88-48a6-423e-8672-9e9725263cb1 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:21.571870 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29ae8e-3682-4f25-9482-455de4f56c57 admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:21.580382 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf5e88-48a6-423e-8672-9e9725263cb1 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:21.589611 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 581/1161] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 00:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 00:25:21.589766 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbea88-c805-43b7-823e-84037a249d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:21.589766 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbea88-c805-43b7-823e-84037a249d84 admin admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:21.589766 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbea88-c805-43b7-823e-84037a249d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:21.589766 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbea88-c805-43b7-823e-84037a249d84 admin admin] PATH_INFO: `/v3/domains` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:21.590146 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbea88-c805-43b7-823e-84037a249d84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 00:25:21.590146 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbea88-c805-43b7-823e-84037a249d84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:21.590146 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: WARNING py.warnings [None req-5dbbea88-c805-43b7-823e-84037a249d84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:25:21.590146 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: warnings.warn(msg) Aug 24 00:25:21.590146 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: Aug 24 00:25:21.590146 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbea88-c805-43b7-823e-84037a249d84 admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:21.591951 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29ae8e-3682-4f25-9482-455de4f56c57 admin admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:21.605341 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 581/1162] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 00:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 00:25:21.605532 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29ae8e-3682-4f25-9482-455de4f56c57 admin admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:21.606905 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3705246-ea51-4ffc-a987-8bc7da589e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:21.607523 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3705246-ea51-4ffc-a987-8bc7da589e9f admin admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:21.607806 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3705246-ea51-4ffc-a987-8bc7da589e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:21.608079 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3705246-ea51-4ffc-a987-8bc7da589e9f admin admin] PATH_INFO: `/v3/projects` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:21.608702 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3705246-ea51-4ffc-a987-8bc7da589e9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:21.609723 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: WARNING py.warnings [None req-b3705246-ea51-4ffc-a987-8bc7da589e9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:25:21.609723 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: warnings.warn(msg) Aug 24 00:25:21.609723 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: Aug 24 00:25:21.610114 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbea88-c805-43b7-823e-84037a249d84 admin admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:21.610940 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3705246-ea51-4ffc-a987-8bc7da589e9f admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:21.619891 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbea88-c805-43b7-823e-84037a249d84 admin admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:21.624462 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3dcca-881d-4ac1-a56e-040b13aea585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:21.625043 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3dcca-881d-4ac1-a56e-040b13aea585 admin admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:21.625322 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3dcca-881d-4ac1-a56e-040b13aea585 admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:21.625595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3dcca-881d-4ac1-a56e-040b13aea585 admin admin] PATH_INFO: `/v3/projects` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:21.626214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3dcca-881d-4ac1-a56e-040b13aea585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:21.628182 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3dcca-881d-4ac1-a56e-040b13aea585 admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:21.649753 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 582/1163] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 00:25:21 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:25:21.653885 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3705246-ea51-4ffc-a987-8bc7da589e9f admin admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:21.663029 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 582/1164] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 00:25:21 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:25:21.664810 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3dcca-881d-4ac1-a56e-040b13aea585 admin admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:21.717833 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3705246-ea51-4ffc-a987-8bc7da589e9f admin admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:21.722511 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f5bbd-caa5-4231-afa9-9f50c1c662b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:21.723271 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f5bbd-caa5-4231-afa9-9f50c1c662b5 admin admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:21.723493 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f5bbd-caa5-4231-afa9-9f50c1c662b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:21.723764 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f5bbd-caa5-4231-afa9-9f50c1c662b5 admin admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:21.724386 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f5bbd-caa5-4231-afa9-9f50c1c662b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:21.726107 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3dcca-881d-4ac1-a56e-040b13aea585 admin admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:21.726314 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f5bbd-caa5-4231-afa9-9f50c1c662b5 admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:21.735092 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce7264-8863-4afd-aef1-7766a9605917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:21.735895 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce7264-8863-4afd-aef1-7766a9605917 admin admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:21.736178 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce7264-8863-4afd-aef1-7766a9605917 admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:21.736453 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce7264-8863-4afd-aef1-7766a9605917 admin admin] PATH_INFO: `/v3/users` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:21.737083 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce7264-8863-4afd-aef1-7766a9605917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:21.738102 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: WARNING py.warnings [None req-6fce7264-8863-4afd-aef1-7766a9605917 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:25:21.738102 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: warnings.warn(msg) Aug 24 00:25:21.738102 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: Aug 24 00:25:21.739748 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce7264-8863-4afd-aef1-7766a9605917 admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:21.760041 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 583/1165] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 00:25:21 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:25:21.764480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f5bbd-caa5-4231-afa9-9f50c1c662b5 admin admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:21.770753 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 583/1166] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 00:25:21 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 00:25:21.771817 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce7264-8863-4afd-aef1-7766a9605917 admin admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:21.775868 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f5bbd-caa5-4231-afa9-9f50c1c662b5 admin admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:21.781403 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d0a16-3307-4869-bdb4-97e754d79689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:21.781571 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce7264-8863-4afd-aef1-7766a9605917 admin admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:21.781992 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d0a16-3307-4869-bdb4-97e754d79689 admin admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:21.782269 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d0a16-3307-4869-bdb4-97e754d79689 admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:21.782581 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d0a16-3307-4869-bdb4-97e754d79689 admin admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:21.783200 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d0a16-3307-4869-bdb4-97e754d79689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:21.784809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d0a16-3307-4869-bdb4-97e754d79689 admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:21.786419 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931adce-d1e2-4ce0-987f-d5eb2fabc576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:21.787023 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931adce-d1e2-4ce0-987f-d5eb2fabc576 admin admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:21.787387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931adce-d1e2-4ce0-987f-d5eb2fabc576 admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:21.787663 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931adce-d1e2-4ce0-987f-d5eb2fabc576 admin admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:21.788321 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931adce-d1e2-4ce0-987f-d5eb2fabc576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:21.789934 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931adce-d1e2-4ce0-987f-d5eb2fabc576 admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:21.794960 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 584/1167] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 00:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:25:21.799228 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d0a16-3307-4869-bdb4-97e754d79689 admin admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:21.804141 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 584/1168] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 00:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 00:25:21.805275 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931adce-d1e2-4ce0-987f-d5eb2fabc576 admin admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:21.809325 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d0a16-3307-4869-bdb4-97e754d79689 admin admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:21.814633 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f7ab7-95f9-4551-a7df-fd48a15c663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:21.815234 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f7ab7-95f9-4551-a7df-fd48a15c663d admin admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:21.815353 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931adce-d1e2-4ce0-987f-d5eb2fabc576 admin admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:21.815509 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f7ab7-95f9-4551-a7df-fd48a15c663d admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:21.815776 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f7ab7-95f9-4551-a7df-fd48a15c663d admin admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:21.816401 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f7ab7-95f9-4551-a7df-fd48a15c663d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:21.818528 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f7ab7-95f9-4551-a7df-fd48a15c663d admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:21.820406 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caee7da-d05d-4153-8a2c-d240a3ba573d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:21.820972 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caee7da-d05d-4153-8a2c-d240a3ba573d admin admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:21.821250 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caee7da-d05d-4153-8a2c-d240a3ba573d admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:21.821523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caee7da-d05d-4153-8a2c-d240a3ba573d admin admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:21.822144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caee7da-d05d-4153-8a2c-d240a3ba573d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:21.823775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caee7da-d05d-4153-8a2c-d240a3ba573d admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:21.829359 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 585/1169] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 00:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:25:21.833966 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f7ab7-95f9-4551-a7df-fd48a15c663d admin admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:21.835027 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 585/1170] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 00:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:25:21.838271 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caee7da-d05d-4153-8a2c-d240a3ba573d admin admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:21.846766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f7ab7-95f9-4551-a7df-fd48a15c663d admin admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:21.847694 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caee7da-d05d-4153-8a2c-d240a3ba573d admin admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:21.851502 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e146100-34f3-416f-b34c-2a7f3b84a8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:21.852130 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e146100-34f3-416f-b34c-2a7f3b84a8b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:21.852262 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91737a3c-2705-44fa-98fc-67ae5e40e6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:21.852422 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e146100-34f3-416f-b34c-2a7f3b84a8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:21.852669 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e146100-34f3-416f-b34c-2a7f3b84a8b4 admin admin] PATH_INFO: `/v3/projects/757272a76f804a22a7ecb549bae0416c/users/c8428bb38b72494eb9ce37c3f2978dd4/roles/3fe3a1eb546b456aa3c8bce846a8d37f` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:21.852846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91737a3c-2705-44fa-98fc-67ae5e40e6f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:21.853131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91737a3c-2705-44fa-98fc-67ae5e40e6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:21.853446 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91737a3c-2705-44fa-98fc-67ae5e40e6f7 admin admin] PATH_INFO: `/v3/projects/f3789086be774bee8792a7b41c5c47a0/users/1d5d36e9b4ec4f7fb2d31b35376ecc09/roles/3fe3a1eb546b456aa3c8bce846a8d37f` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:21.867414 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e146100-34f3-416f-b34c-2a7f3b84a8b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=757272a76f804a22a7ecb549bae0416c, user_id=c8428bb38b72494eb9ce37c3f2978dd4, role_id=3fe3a1eb546b456aa3c8bce846a8d37f)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:21.868444 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: WARNING py.warnings [None req-0e146100-34f3-416f-b34c-2a7f3b84a8b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:25:21.868444 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: warnings.warn(msg) Aug 24 00:25:21.868444 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: Aug 24 00:25:21.868989 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91737a3c-2705-44fa-98fc-67ae5e40e6f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3789086be774bee8792a7b41c5c47a0, user_id=1d5d36e9b4ec4f7fb2d31b35376ecc09, role_id=3fe3a1eb546b456aa3c8bce846a8d37f)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:21.870404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e146100-34f3-416f-b34c-2a7f3b84a8b4 admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:21.871743 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91737a3c-2705-44fa-98fc-67ae5e40e6f7 admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:21.885247 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 586/1171] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 00:25:21 2022] PUT /identity/v3/projects/757272a76f804a22a7ecb549bae0416c/users/c8428bb38b72494eb9ce37c3f2978dd4/roles/3fe3a1eb546b456aa3c8bce846a8d37f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 00:25:21.886518 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 586/1172] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 00:25:21 2022] PUT /identity/v3/projects/f3789086be774bee8792a7b41c5c47a0/users/1d5d36e9b4ec4f7fb2d31b35376ecc09/roles/3fe3a1eb546b456aa3c8bce846a8d37f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 00:25:21.890249 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d627b-d97a-4803-a5e5-5bc5d59a27b5 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:21.890557 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d627b-d97a-4803-a5e5-5bc5d59a27b5 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:21.890808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d627b-d97a-4803-a5e5-5bc5d59a27b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:21.891345 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7686b-bdec-47af-ac31-2a5b629a4980 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:21.891656 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7686b-bdec-47af-ac31-2a5b629a4980 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:21.891932 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7686b-bdec-47af-ac31-2a5b629a4980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:21.910378 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-ee5d627b-d97a-4803-a5e5-5bc5d59a27b5 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:21.910696 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-1ae7686b-bdec-47af-ac31-2a5b629a4980 None None] MFA Rules not processed for user `ba9622273acc4179a07cafb4c9699780`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:21.912193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-ee5d627b-d97a-4803-a5e5-5bc5d59a27b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:21.912324 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-1ae7686b-bdec-47af-ac31-2a5b629a4980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:21.954888 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:25:21.961308 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:25:21.973503 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 587/1173] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:25:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:25:21.974127 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 587/1174] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:25:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:25:21.984012 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d627b-d97a-4803-a5e5-5bc5d59a27b5 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:21.984335 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7686b-bdec-47af-ac31-2a5b629a4980 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:21.985480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-ee5d627b-d97a-4803-a5e5-5bc5d59a27b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:22.039166 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7686b-bdec-47af-ac31-2a5b629a4980 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:22.042847 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075bf47-bbb3-49a6-b087-2c70fb2dae85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:22.043486 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075bf47-bbb3-49a6-b087-2c70fb2dae85 service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:22.043761 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075bf47-bbb3-49a6-b087-2c70fb2dae85 service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:22.044038 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075bf47-bbb3-49a6-b087-2c70fb2dae85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:22.054732 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075bf47-bbb3-49a6-b087-2c70fb2dae85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:22.055797 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d627b-d97a-4803-a5e5-5bc5d59a27b5 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:22.057218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075bf47-bbb3-49a6-b087-2c70fb2dae85 service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:22.059514 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d34f7-a85d-4e04-9e2d-b731aba5cdb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:22.060126 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d34f7-a85d-4e04-9e2d-b731aba5cdb9 service neutron] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:22.060404 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d34f7-a85d-4e04-9e2d-b731aba5cdb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:22.060671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d34f7-a85d-4e04-9e2d-b731aba5cdb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:22.069863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 588/1175] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:25:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:25:22.072214 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d34f7-a85d-4e04-9e2d-b731aba5cdb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:22.073679 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d34f7-a85d-4e04-9e2d-b731aba5cdb9 service neutron] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:22.084337 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 588/1176] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:25:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:25:26.944103 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ec14f-16f4-4e09-a429-6be4adf28ffa None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:26.944652 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ec14f-16f4-4e09-a429-6be4adf28ffa None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:26.944652 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ec14f-16f4-4e09-a429-6be4adf28ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:26.990252 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-c58ec14f-16f4-4e09-a429-6be4adf28ffa None None] MFA Rules not processed for user `1d5d36e9b4ec4f7fb2d31b35376ecc09`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:26.991777 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-c58ec14f-16f4-4e09-a429-6be4adf28ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:27.123494 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 589/1177] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:25:26 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:25:27.127987 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d34f7-a85d-4e04-9e2d-b731aba5cdb9 service neutron] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:27.152324 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d34f7-a85d-4e04-9e2d-b731aba5cdb9 service neutron] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:27.162409 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befe2d8-2549-48fa-b761-8b20aaaac4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:27.163336 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befe2d8-2549-48fa-b761-8b20aaaac4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:27.163671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befe2d8-2549-48fa-b761-8b20aaaac4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:27.164150 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befe2d8-2549-48fa-b761-8b20aaaac4e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:27.165686 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befe2d8-2549-48fa-b761-8b20aaaac4e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:27.170218 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befe2d8-2549-48fa-b761-8b20aaaac4e5 admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:27.260704 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 589/1178] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 00:25:27 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:25:27.261898 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ec14f-16f4-4e09-a429-6be4adf28ffa None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:27.278815 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ec14f-16f4-4e09-a429-6be4adf28ffa None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:27.366573 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc5f3d-ddea-43f3-b649-aedf31648e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:27.367228 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc5f3d-ddea-43f3-b649-aedf31648e6d admin admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:27.367770 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc5f3d-ddea-43f3-b649-aedf31648e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:27.368061 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc5f3d-ddea-43f3-b649-aedf31648e6d admin admin] PATH_INFO: `/v3/users` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:27.369233 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc5f3d-ddea-43f3-b649-aedf31648e6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:27.372680 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc5f3d-ddea-43f3-b649-aedf31648e6d admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:27.412080 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befe2d8-2549-48fa-b761-8b20aaaac4e5 admin admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:27.412613 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 590/1179] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 00:25:27 2022] POST /identity/v3/users => generated 299 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:25:27.434714 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befe2d8-2549-48fa-b761-8b20aaaac4e5 admin admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:27.445296 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92062b-fa65-492b-b315-8e123bc37c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:27.446646 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92062b-fa65-492b-b315-8e123bc37c8e admin admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:27.446931 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92062b-fa65-492b-b315-8e123bc37c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:27.447219 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92062b-fa65-492b-b315-8e123bc37c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:27.447874 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92062b-fa65-492b-b315-8e123bc37c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:27.450443 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92062b-fa65-492b-b315-8e123bc37c8e admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:27.467473 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 590/1180] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 00:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 00:25:27.471358 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc5f3d-ddea-43f3-b649-aedf31648e6d admin admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:27.491328 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc5f3d-ddea-43f3-b649-aedf31648e6d admin admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:27.498026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd314074-a78b-4b8b-a0ac-e1642cca9db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:27.498757 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd314074-a78b-4b8b-a0ac-e1642cca9db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:27.499068 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd314074-a78b-4b8b-a0ac-e1642cca9db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:27.499397 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd314074-a78b-4b8b-a0ac-e1642cca9db1 admin admin] PATH_INFO: `/v3/projects/fcba40a2efb8414590fa4cb42de22d60/users/c1dd8686bbf242e0bffe3a5c32d51fa4/roles/9b372d4fe82a4a54a3ecd29e7b912586` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:27.517545 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd314074-a78b-4b8b-a0ac-e1642cca9db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcba40a2efb8414590fa4cb42de22d60, user_id=c1dd8686bbf242e0bffe3a5c32d51fa4, role_id=9b372d4fe82a4a54a3ecd29e7b912586)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:27.520828 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd314074-a78b-4b8b-a0ac-e1642cca9db1 admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:27.524663 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:25:27.550441 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 591/1181] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 00:25:27 2022] PUT /identity/v3/projects/fcba40a2efb8414590fa4cb42de22d60/users/c1dd8686bbf242e0bffe3a5c32d51fa4/roles/9b372d4fe82a4a54a3ecd29e7b912586 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:25:27.552463 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92062b-fa65-492b-b315-8e123bc37c8e admin admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:27.563038 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92062b-fa65-492b-b315-8e123bc37c8e admin admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:27.641600 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a26a2-bdd6-4025-be30-2b156a8933ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:27.641829 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a26a2-bdd6-4025-be30-2b156a8933ca admin admin] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:27.642055 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a26a2-bdd6-4025-be30-2b156a8933ca admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:27.642391 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a26a2-bdd6-4025-be30-2b156a8933ca admin admin] PATH_INFO: `/v3/roles` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:27.643390 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a26a2-bdd6-4025-be30-2b156a8933ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:27.644779 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a26a2-bdd6-4025-be30-2b156a8933ca admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:27.663243 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 591/1182] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 00:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:25:27.665130 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd314074-a78b-4b8b-a0ac-e1642cca9db1 admin admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:27.681629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd314074-a78b-4b8b-a0ac-e1642cca9db1 admin admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:27.687113 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ca2a6-224d-4f95-a1fc-f18a720a9691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:27.687628 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ff7b8-2731-4a35-900c-e4e5985b19fd None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:27.687989 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ff7b8-2731-4a35-900c-e4e5985b19fd None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:27.688361 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ff7b8-2731-4a35-900c-e4e5985b19fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:27.688744 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ca2a6-224d-4f95-a1fc-f18a720a9691 admin admin] REQUEST_METHOD: `PUT` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:27.689223 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ca2a6-224d-4f95-a1fc-f18a720a9691 admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:27.689701 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ca2a6-224d-4f95-a1fc-f18a720a9691 admin admin] PATH_INFO: `/v3/projects/fcba40a2efb8414590fa4cb42de22d60/users/c1dd8686bbf242e0bffe3a5c32d51fa4/roles/9b372d4fe82a4a54a3ecd29e7b912586` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:27.691951 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ca2a6-224d-4f95-a1fc-f18a720a9691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcba40a2efb8414590fa4cb42de22d60, user_id=c1dd8686bbf242e0bffe3a5c32d51fa4, role_id=9b372d4fe82a4a54a3ecd29e7b912586)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:27.694834 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ca2a6-224d-4f95-a1fc-f18a720a9691 admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:27.710163 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 592/1183] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 00:25:27 2022] PUT /identity/v3/projects/fcba40a2efb8414590fa4cb42de22d60/users/c1dd8686bbf242e0bffe3a5c32d51fa4/roles/9b372d4fe82a4a54a3ecd29e7b912586 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:25:27.722217 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-860ff7b8-2731-4a35-900c-e4e5985b19fd None None] MFA Rules not processed for user `c8428bb38b72494eb9ce37c3f2978dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:27.723999 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-860ff7b8-2731-4a35-900c-e4e5985b19fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:27.763689 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:25:27.813808 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 592/1184] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:25:27 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:25:27.818840 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ca2a6-224d-4f95-a1fc-f18a720a9691 admin admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:27.937477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ca2a6-224d-4f95-a1fc-f18a720a9691 admin admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:27.946401 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46dad0-474b-453f-b381-23d58ba87f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:27.947256 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46dad0-474b-453f-b381-23d58ba87f97 admin admin] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:27.947647 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46dad0-474b-453f-b381-23d58ba87f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:27.948001 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46dad0-474b-453f-b381-23d58ba87f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:27.949191 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46dad0-474b-453f-b381-23d58ba87f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:27.951532 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46dad0-474b-453f-b381-23d58ba87f97 admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:27.988921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 593/1185] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 00:25:27 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:25:27.992865 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ff7b8-2731-4a35-900c-e4e5985b19fd None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:28.012135 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ff7b8-2731-4a35-900c-e4e5985b19fd None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:28.105831 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568dbdd-01bf-477c-a55f-75fd07b7102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:28.106617 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568dbdd-01bf-477c-a55f-75fd07b7102a admin admin] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:28.106895 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568dbdd-01bf-477c-a55f-75fd07b7102a admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:28.107206 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568dbdd-01bf-477c-a55f-75fd07b7102a admin admin] PATH_INFO: `/v3/users` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:28.107842 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568dbdd-01bf-477c-a55f-75fd07b7102a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:28.109819 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568dbdd-01bf-477c-a55f-75fd07b7102a admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:28.142275 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 593/1186] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 00:25:27 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 00:25:28.146073 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46dad0-474b-453f-b381-23d58ba87f97 admin admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:28.156935 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46dad0-474b-453f-b381-23d58ba87f97 admin admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:28.162086 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6bc3c-fd77-4381-9c3b-89e23c854046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:28.162715 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6bc3c-fd77-4381-9c3b-89e23c854046 admin admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:28.162986 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6bc3c-fd77-4381-9c3b-89e23c854046 admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:28.163299 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6bc3c-fd77-4381-9c3b-89e23c854046 admin admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:28.163950 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6bc3c-fd77-4381-9c3b-89e23c854046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:28.165644 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6bc3c-fd77-4381-9c3b-89e23c854046 admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:28.186657 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568dbdd-01bf-477c-a55f-75fd07b7102a admin admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:28.187225 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 594/1187] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 00:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:25:28.202428 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568dbdd-01bf-477c-a55f-75fd07b7102a admin admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:28.207426 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d037db7-d6b1-4f16-a08b-2591c9d75ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:28.208562 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d037db7-d6b1-4f16-a08b-2591c9d75ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:28.209025 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d037db7-d6b1-4f16-a08b-2591c9d75ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:28.209298 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d037db7-d6b1-4f16-a08b-2591c9d75ac0 admin admin] PATH_INFO: `/v3/projects/0cd7caa079674542b11075764223a032/users/54df5c8ddd274c408152194a1678911c/roles/9b372d4fe82a4a54a3ecd29e7b912586` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:28.226046 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d037db7-d6b1-4f16-a08b-2591c9d75ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd7caa079674542b11075764223a032, user_id=54df5c8ddd274c408152194a1678911c, role_id=9b372d4fe82a4a54a3ecd29e7b912586)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:28.229072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d037db7-d6b1-4f16-a08b-2591c9d75ac0 admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:28.249180 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 594/1188] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 00:25:28 2022] PUT /identity/v3/projects/0cd7caa079674542b11075764223a032/users/54df5c8ddd274c408152194a1678911c/roles/9b372d4fe82a4a54a3ecd29e7b912586 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 00:25:28.251701 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6bc3c-fd77-4381-9c3b-89e23c854046 admin admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:28.270641 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6bc3c-fd77-4381-9c3b-89e23c854046 admin admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:28.350282 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e049414-33cb-496b-a5c6-3ca686cb0e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:28.351098 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e049414-33cb-496b-a5c6-3ca686cb0e09 admin admin] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:28.351399 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e049414-33cb-496b-a5c6-3ca686cb0e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:28.351707 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e049414-33cb-496b-a5c6-3ca686cb0e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:28.352481 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e049414-33cb-496b-a5c6-3ca686cb0e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:28.354758 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e049414-33cb-496b-a5c6-3ca686cb0e09 admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:28.367560 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 595/1189] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 00:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 00:25:28.371559 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d037db7-d6b1-4f16-a08b-2591c9d75ac0 admin admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:28.385218 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d037db7-d6b1-4f16-a08b-2591c9d75ac0 admin admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:28.395724 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410d798-194b-49fc-aa73-614a233d4d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:28.396497 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410d798-194b-49fc-aa73-614a233d4d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:28.397075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410d798-194b-49fc-aa73-614a233d4d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:28.397546 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410d798-194b-49fc-aa73-614a233d4d9a admin admin] PATH_INFO: `/v3/projects/0cd7caa079674542b11075764223a032/users/54df5c8ddd274c408152194a1678911c/roles/9b372d4fe82a4a54a3ecd29e7b912586` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:28.400139 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410d798-194b-49fc-aa73-614a233d4d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd7caa079674542b11075764223a032, user_id=54df5c8ddd274c408152194a1678911c, role_id=9b372d4fe82a4a54a3ecd29e7b912586)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:28.403121 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410d798-194b-49fc-aa73-614a233d4d9a admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:28.434634 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 595/1190] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 00:25:28 2022] PUT /identity/v3/projects/0cd7caa079674542b11075764223a032/users/54df5c8ddd274c408152194a1678911c/roles/9b372d4fe82a4a54a3ecd29e7b912586 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:25:33.622344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d94ef2-6814-4fae-8245-883b1fcaba37 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:33.622821 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d94ef2-6814-4fae-8245-883b1fcaba37 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:33.622943 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d94ef2-6814-4fae-8245-883b1fcaba37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:33.678952 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-22d94ef2-6814-4fae-8245-883b1fcaba37 None None] MFA Rules not processed for user `c1dd8686bbf242e0bffe3a5c32d51fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:33.685905 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-22d94ef2-6814-4fae-8245-883b1fcaba37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:33.755168 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:25:33.806271 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 596/1191] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:25:33 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:25:33.817277 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410d798-194b-49fc-aa73-614a233d4d9a admin admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:33.819054 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-b410d798-194b-49fc-aa73-614a233d4d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:33.935034 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410d798-194b-49fc-aa73-614a233d4d9a admin admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:33.939826 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff0902-e5b7-499c-80d3-d771c90b5273 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b588c52178934bce8cceff804a8f6e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:33.940185 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff0902-e5b7-499c-80d3-d771c90b5273 service glance] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:33.940311 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff0902-e5b7-499c-80d3-d771c90b5273 service glance] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:33.940669 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff0902-e5b7-499c-80d3-d771c90b5273 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:33.975900 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:25:34.024357 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff0902-e5b7-499c-80d3-d771c90b5273 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:34.025991 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff0902-e5b7-499c-80d3-d771c90b5273 service glance] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:34.040364 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 596/1192] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:25:33 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:25:34.560345 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63601f17-5f9c-44b3-9708-da8f342b8d3d None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:34.560636 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63601f17-5f9c-44b3-9708-da8f342b8d3d None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:34.560935 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63601f17-5f9c-44b3-9708-da8f342b8d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:34.668296 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-63601f17-5f9c-44b3-9708-da8f342b8d3d None None] MFA Rules not processed for user `54df5c8ddd274c408152194a1678911c`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:34.670615 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-63601f17-5f9c-44b3-9708-da8f342b8d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:34.777293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 597/1193] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:25:34 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:25:34.788484 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff0902-e5b7-499c-80d3-d771c90b5273 service glance] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:34.802148 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff0902-e5b7-499c-80d3-d771c90b5273 service glance] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:34.808700 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce844d-e20e-45c9-9e1d-b6e1fd24330d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b588c52178934bce8cceff804a8f6e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:34.809979 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce844d-e20e-45c9-9e1d-b6e1fd24330d service glance] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:34.810357 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce844d-e20e-45c9-9e1d-b6e1fd24330d service glance] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:34.810707 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce844d-e20e-45c9-9e1d-b6e1fd24330d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:34.943704 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce844d-e20e-45c9-9e1d-b6e1fd24330d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:34.946238 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce844d-e20e-45c9-9e1d-b6e1fd24330d service glance] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:34.968755 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 597/1194] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:25:34 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:25:42.667550 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b98d7-f708-4401-b21a-0ca43b6362ba None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:42.668491 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b98d7-f708-4401-b21a-0ca43b6362ba None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:42.668491 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b98d7-f708-4401-b21a-0ca43b6362ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:42.692175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-f39b98d7-f708-4401-b21a-0ca43b6362ba None None] MFA Rules not processed for user `1d5d36e9b4ec4f7fb2d31b35376ecc09`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:42.693385 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-f39b98d7-f708-4401-b21a-0ca43b6362ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:42.703057 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 598/1195] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:25:42 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:25:43.010046 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e639d-7c96-4f49-85d6-b2c723a34fee None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:43.010626 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e639d-7c96-4f49-85d6-b2c723a34fee None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:43.010896 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e639d-7c96-4f49-85d6-b2c723a34fee None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:43.013524 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 598/1196] 10.222.0.42 () {54 vars in 962 bytes} [Wed Aug 24 00:25:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:25:43.020633 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9849d5-4670-4a93-8add-eee7db721fb7 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:43.020633 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9849d5-4670-4a93-8add-eee7db721fb7 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:43.020892 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9849d5-4670-4a93-8add-eee7db721fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:43.055951 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-3f9849d5-4670-4a93-8add-eee7db721fb7 None None] MFA Rules not processed for user `a863e95438d14892816e4f3c94673025`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:43.057244 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-3f9849d5-4670-4a93-8add-eee7db721fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:43.134336 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 599/1197] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Aug 24 00:25:43 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:25:43.139881 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5de410-7d87-4605-b006-1b7969ab65ec None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:43.140170 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5de410-7d87-4605-b006-1b7969ab65ec None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:43.140441 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5de410-7d87-4605-b006-1b7969ab65ec None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:43.141880 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 599/1198] 10.222.0.42 () {54 vars in 912 bytes} [Wed Aug 24 00:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:25:43.147285 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62495d9f-bb59-4c8c-9b38-e7a262f56ed1 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:43.147654 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62495d9f-bb59-4c8c-9b38-e7a262f56ed1 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:43.147929 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62495d9f-bb59-4c8c-9b38-e7a262f56ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:43.168266 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-62495d9f-bb59-4c8c-9b38-e7a262f56ed1 None None] MFA Rules not processed for user `a863e95438d14892816e4f3c94673025`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:43.169583 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-62495d9f-bb59-4c8c-9b38-e7a262f56ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:43.179201 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 600/1199] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 24 00:25:43 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:25:43.193543 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5de410-7d87-4605-b006-1b7969ab65ec None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:43.195322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-1e5de410-7d87-4605-b006-1b7969ab65ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:43.209470 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5de410-7d87-4605-b006-1b7969ab65ec None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:43.213216 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a10cf-29ca-4022-b84e-d40510eaa92a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b588c52178934bce8cceff804a8f6e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:43.214012 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a10cf-29ca-4022-b84e-d40510eaa92a service glance] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:43.214300 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a10cf-29ca-4022-b84e-d40510eaa92a service glance] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:43.214580 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a10cf-29ca-4022-b84e-d40510eaa92a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:43.225021 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a10cf-29ca-4022-b84e-d40510eaa92a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:43.226494 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a10cf-29ca-4022-b84e-d40510eaa92a service glance] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:43.237902 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 600/1200] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:25:43 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:25:43.695129 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664794ea-dff5-4420-a03d-91dbe4fc14e7 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:43.695703 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664794ea-dff5-4420-a03d-91dbe4fc14e7 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:43.695829 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664794ea-dff5-4420-a03d-91dbe4fc14e7 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:43.697572 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 601/1201] 10.222.0.42 () {54 vars in 912 bytes} [Wed Aug 24 00:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:25:43.710859 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c27ee-b782-4a79-a7d4-39d816d0067a None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:43.711216 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c27ee-b782-4a79-a7d4-39d816d0067a None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:43.711452 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c27ee-b782-4a79-a7d4-39d816d0067a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:43.732521 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-e38c27ee-b782-4a79-a7d4-39d816d0067a None None] MFA Rules not processed for user `ad894f6b3613401c88cd3b39d825e61d`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:43.733778 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-e38c27ee-b782-4a79-a7d4-39d816d0067a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:43.793108 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 601/1202] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 24 00:25:43 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:25:43.805997 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664794ea-dff5-4420-a03d-91dbe4fc14e7 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:43.819284 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664794ea-dff5-4420-a03d-91dbe4fc14e7 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:43.822787 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b4421-5f45-4c06-ba40-1a834f4fd5de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:43.823465 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b4421-5f45-4c06-ba40-1a834f4fd5de service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:43.823746 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b4421-5f45-4c06-ba40-1a834f4fd5de service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:43.824026 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b4421-5f45-4c06-ba40-1a834f4fd5de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:43.833517 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b4421-5f45-4c06-ba40-1a834f4fd5de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:43.835288 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b4421-5f45-4c06-ba40-1a834f4fd5de service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:43.845136 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 602/1203] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:25:43 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:25:44.318933 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faeed7-c7ba-4514-93de-54cf572e7e73 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:44.319540 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faeed7-c7ba-4514-93de-54cf572e7e73 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:44.319644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faeed7-c7ba-4514-93de-54cf572e7e73 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:44.321042 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 602/1204] 10.222.0.42 () {54 vars in 962 bytes} [Wed Aug 24 00:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:25:44.328390 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37e2bc-0cf2-4d7d-8e35-1b8486d6397b None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:44.328605 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37e2bc-0cf2-4d7d-8e35-1b8486d6397b None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:44.332842 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37e2bc-0cf2-4d7d-8e35-1b8486d6397b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:44.363170 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-4d37e2bc-0cf2-4d7d-8e35-1b8486d6397b None None] MFA Rules not processed for user `a863e95438d14892816e4f3c94673025`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:44.368958 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faeed7-c7ba-4514-93de-54cf572e7e73 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:44.370693 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-4d37e2bc-0cf2-4d7d-8e35-1b8486d6397b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:44.387939 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 603/1205] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Aug 24 00:25:44 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:25:44.389626 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34781a93-9cb4-40c4-8949-a09f8d567bf9 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:44.389919 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34781a93-9cb4-40c4-8949-a09f8d567bf9 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:44.390195 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34781a93-9cb4-40c4-8949-a09f8d567bf9 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:44.397403 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 604/1206] 10.222.0.42 () {54 vars in 912 bytes} [Wed Aug 24 00:25:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:25:44.398895 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6a9c-83ea-4cf3-a9e7-76d07d9a28df None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:44.399209 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6a9c-83ea-4cf3-a9e7-76d07d9a28df None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:44.399531 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6a9c-83ea-4cf3-a9e7-76d07d9a28df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:44.441218 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-1b6f6a9c-83ea-4cf3-a9e7-76d07d9a28df None None] MFA Rules not processed for user `a863e95438d14892816e4f3c94673025`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:44.443387 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-1b6f6a9c-83ea-4cf3-a9e7-76d07d9a28df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:44.463474 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 605/1207] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 24 00:25:44 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:25:44.469990 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f6a9c-83ea-4cf3-a9e7-76d07d9a28df None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:44.496257 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f6a9c-83ea-4cf3-a9e7-76d07d9a28df None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:44.500489 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=100 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:25:44.507682 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faeed7-c7ba-4514-93de-54cf572e7e73 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:44.508588 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f2925-4b20-4a26-acab-108a07b4b302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:44.509410 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f2925-4b20-4a26-acab-108a07b4b302 service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:44.519811 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f2925-4b20-4a26-acab-108a07b4b302 service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:44.520332 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f2925-4b20-4a26-acab-108a07b4b302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:44.523099 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10ea26-d83a-43f8-929e-9930fbaf7514 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebffbdf5a1234167903a9fd4490bb174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:44.523927 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10ea26-d83a-43f8-929e-9930fbaf7514 service placement] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:44.524994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10ea26-d83a-43f8-929e-9930fbaf7514 service placement] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:44.524994 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10ea26-d83a-43f8-929e-9930fbaf7514 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:44.527075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-af10ea26-d83a-43f8-929e-9930fbaf7514 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:44.527468 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=100 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:25:44.538929 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f2925-4b20-4a26-acab-108a07b4b302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:44.540517 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f2925-4b20-4a26-acab-108a07b4b302 service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:44.546739 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10ea26-d83a-43f8-929e-9930fbaf7514 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:44.548990 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10ea26-d83a-43f8-929e-9930fbaf7514 service placement] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:44.565245 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 606/1208] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:25:44 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:25:44.577418 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 603/1209] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:25:44 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:25:54.553853 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=3 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:25:54.560512 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=4 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:25:54.979953 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd1528-6c81-4a90-8dbf-74e25a11629d None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:54.980298 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd1528-6c81-4a90-8dbf-74e25a11629d None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:54.980563 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd1528-6c81-4a90-8dbf-74e25a11629d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:55.004733 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-02cd1528-6c81-4a90-8dbf-74e25a11629d None None] MFA Rules not processed for user `ad894f6b3613401c88cd3b39d825e61d`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:55.005936 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-02cd1528-6c81-4a90-8dbf-74e25a11629d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:55.012863 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 607/1210] 10.222.0.73 () {58 vars in 1015 bytes} [Wed Aug 24 00:25:54 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:25:55.040232 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10ea26-d83a-43f8-929e-9930fbaf7514 service placement] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:55.053001 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10ea26-d83a-43f8-929e-9930fbaf7514 service placement] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:55.056693 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be170f03-a784-4523-9009-c00e1485d283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:55.057298 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be170f03-a784-4523-9009-c00e1485d283 service neutron] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:55.057583 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be170f03-a784-4523-9009-c00e1485d283 service neutron] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:55.057856 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be170f03-a784-4523-9009-c00e1485d283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:55.066601 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be170f03-a784-4523-9009-c00e1485d283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:55.068102 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be170f03-a784-4523-9009-c00e1485d283 service neutron] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:55.081871 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 604/1211] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:25:55 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:25:56.020347 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5df2c-e050-417c-838d-e7783e76b5c4 None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:56.020921 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5df2c-e050-417c-838d-e7783e76b5c4 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:56.021059 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5df2c-e050-417c-838d-e7783e76b5c4 None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:56.022601 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 608/1212] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 24 00:25:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:25:56.052770 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b3a7d-20fd-4430-91c6-02f43be6705f None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:56.053451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b3a7d-20fd-4430-91c6-02f43be6705f None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:56.053451 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b3a7d-20fd-4430-91c6-02f43be6705f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:56.079192 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-b68b3a7d-20fd-4430-91c6-02f43be6705f None None] MFA Rules not processed for user `a863e95438d14892816e4f3c94673025`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:25:56.081717 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-b68b3a7d-20fd-4430-91c6-02f43be6705f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:25:56.092270 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 605/1213] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 24 00:25:56 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:25:56.114472 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5df2c-e050-417c-838d-e7783e76b5c4 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:25:56.139806 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5df2c-e050-417c-838d-e7783e76b5c4 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:25:56.145943 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb825f2-64c4-49d6-a9bb-c042083949fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:25:56.146540 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb825f2-64c4-49d6-a9bb-c042083949fc service nova] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:25:56.146813 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb825f2-64c4-49d6-a9bb-c042083949fc service nova] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:25:56.147120 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb825f2-64c4-49d6-a9bb-c042083949fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:25:56.156523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb825f2-64c4-49d6-a9bb-c042083949fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:25:56.158107 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb825f2-64c4-49d6-a9bb-c042083949fc service nova] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:25:56.169037 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 609/1214] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:25:56 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:26:02.275725 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce3ff-5e49-4ce6-b993-73336e612569 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:02.276334 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce3ff-5e49-4ce6-b993-73336e612569 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:02.276334 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce3ff-5e49-4ce6-b993-73336e612569 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:02.277606 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 606/1215] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 24 00:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:26:02.289119 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cf727-9da1-406c-bbb8-22e61573cc9a None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:02.289674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cf727-9da1-406c-bbb8-22e61573cc9a None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:02.289674 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cf727-9da1-406c-bbb8-22e61573cc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:02.312836 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-827cf727-9da1-406c-bbb8-22e61573cc9a None None] MFA Rules not processed for user `a863e95438d14892816e4f3c94673025`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:26:02.314045 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-827cf727-9da1-406c-bbb8-22e61573cc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:26:02.325096 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 610/1216] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 24 00:26:02 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:26:02.344138 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ce3ff-5e49-4ce6-b993-73336e612569 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:26:02.359028 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ce3ff-5e49-4ce6-b993-73336e612569 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:26:02.364848 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f54de-a733-4ee4-b9ff-568e678604b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:26:02.365488 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f54de-a733-4ee4-b9ff-568e678604b0 service nova] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:02.365767 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f54de-a733-4ee4-b9ff-568e678604b0 service nova] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:02.366231 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f54de-a733-4ee4-b9ff-568e678604b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:02.374885 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f54de-a733-4ee4-b9ff-568e678604b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:26:02.376507 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f54de-a733-4ee4-b9ff-568e678604b0 service nova] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:26:02.386223 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 607/1217] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:26:02 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:26:12.307329 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=12 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:26:12.382085 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=15 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:26:14.070169 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cf727-9da1-406c-bbb8-22e61573cc9a None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:26:14.081954 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cf727-9da1-406c-bbb8-22e61573cc9a None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:26:14.092158 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b5391-ffa9-4cae-a446-c469159a3bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:26:14.092842 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b5391-ffa9-4cae-a446-c469159a3bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:14.093166 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b5391-ffa9-4cae-a446-c469159a3bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:14.093451 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b5391-ffa9-4cae-a446-c469159a3bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:14.106775 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b5391-ffa9-4cae-a446-c469159a3bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:26:14.108423 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b5391-ffa9-4cae-a446-c469159a3bb2 service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:26:14.118480 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 611/1218] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:26:14 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:26:24.114460 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=6 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:26:37.126805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b2ced-fe67-4ae3-97d0-f33295cdc27d None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:26:37.127912 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b2ced-fe67-4ae3-97d0-f33295cdc27d None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:26:37.128011 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b2ced-fe67-4ae3-97d0-f33295cdc27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:26:37.146482 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-7a0b2ced-fe67-4ae3-97d0-f33295cdc27d None None] MFA Rules not processed for user `c8428bb38b72494eb9ce37c3f2978dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:26:37.147766 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-7a0b2ced-fe67-4ae3-97d0-f33295cdc27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:26:37.154575 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 608/1219] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:26:37 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:26:47.141652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=3 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:27:02.232911 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99fa2e-ffdb-4a46-a231-d394e25250c2 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:02.233469 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99fa2e-ffdb-4a46-a231-d394e25250c2 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:02.233555 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99fa2e-ffdb-4a46-a231-d394e25250c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:02.253507 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-9e99fa2e-ffdb-4a46-a231-d394e25250c2 None None] MFA Rules not processed for user `c8428bb38b72494eb9ce37c3f2978dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:27:02.254701 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-9e99fa2e-ffdb-4a46-a231-d394e25250c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:02.261474 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 612/1220] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:27:02 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:27:02.575668 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bbecc-0a0c-433e-97a0-07a8abc0c0b7 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:02.576107 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bbecc-0a0c-433e-97a0-07a8abc0c0b7 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:02.576217 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bbecc-0a0c-433e-97a0-07a8abc0c0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:02.595121 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-688bbecc-0a0c-433e-97a0-07a8abc0c0b7 None None] MFA Rules not processed for user `ad894f6b3613401c88cd3b39d825e61d`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:27:02.596326 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-688bbecc-0a0c-433e-97a0-07a8abc0c0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:02.602830 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 609/1221] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 24 00:27:02 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:27:02.614074 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99fa2e-ffdb-4a46-a231-d394e25250c2 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:27:02.624553 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99fa2e-ffdb-4a46-a231-d394e25250c2 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:27:02.628646 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf387e-dd40-491d-99b0-24c76358287e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:27:02.629233 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf387e-dd40-491d-99b0-24c76358287e service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:02.629510 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf387e-dd40-491d-99b0-24c76358287e service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:02.629777 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf387e-dd40-491d-99b0-24c76358287e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:02.636732 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf387e-dd40-491d-99b0-24c76358287e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:27:02.638154 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf387e-dd40-491d-99b0-24c76358287e service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:27:02.645760 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 613/1222] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:27:02 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:27:12.590041 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=3 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:27:12.642586 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=9 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:27:17.024794 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0e268-6d8f-40d1-8cf5-01daf422060b None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:27:17.025254 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0e268-6d8f-40d1-8cf5-01daf422060b None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:27:17.025358 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0e268-6d8f-40d1-8cf5-01daf422060b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:27:17.043700 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-91f0e268-6d8f-40d1-8cf5-01daf422060b None None] MFA Rules not processed for user `c8428bb38b72494eb9ce37c3f2978dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:27:17.044900 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-91f0e268-6d8f-40d1-8cf5-01daf422060b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:27:17.052067 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 610/1223] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:27:17 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:27:27.038600 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=3 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:28:14.673219 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91197f-09c9-4972-a30d-7b23f6ba1cb6 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:28:14.673712 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91197f-09c9-4972-a30d-7b23f6ba1cb6 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:28:14.673814 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91197f-09c9-4972-a30d-7b23f6ba1cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:28:14.692998 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-7a91197f-09c9-4972-a30d-7b23f6ba1cb6 None None] MFA Rules not processed for user `c8428bb38b72494eb9ce37c3f2978dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:28:14.694230 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-7a91197f-09c9-4972-a30d-7b23f6ba1cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:28:14.701748 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 614/1224] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:28:14 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:28:24.687733 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=3 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:28:27.665193 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0e268-6d8f-40d1-8cf5-01daf422060b None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:28:27.684873 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0e268-6d8f-40d1-8cf5-01daf422060b None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:28:27.688563 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a9b94-2017-4edd-8594-437a78908697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:28:27.689158 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a9b94-2017-4edd-8594-437a78908697 service neutron] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:28:27.689435 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a9b94-2017-4edd-8594-437a78908697 service neutron] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:28:27.689705 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a9b94-2017-4edd-8594-437a78908697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:28:27.698500 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a9b94-2017-4edd-8594-437a78908697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:28:27.699955 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a9b94-2017-4edd-8594-437a78908697 service neutron] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:28:27.709721 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 611/1225] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:28:27 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:28:37.705536 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=10 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:28:49.389144 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91197f-09c9-4972-a30d-7b23f6ba1cb6 None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:28:49.402194 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91197f-09c9-4972-a30d-7b23f6ba1cb6 None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:28:49.407139 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf4b8b-d148-4efa-bec3-f66939a93f37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebffbdf5a1234167903a9fd4490bb174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:28:49.407788 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf4b8b-d148-4efa-bec3-f66939a93f37 service placement] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:28:49.408070 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf4b8b-d148-4efa-bec3-f66939a93f37 service placement] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:28:49.408344 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf4b8b-d148-4efa-bec3-f66939a93f37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:28:49.416869 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf4b8b-d148-4efa-bec3-f66939a93f37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:28:49.418465 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf4b8b-d148-4efa-bec3-f66939a93f37 service placement] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:28:49.428599 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 615/1226] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:28:49 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:28:59.424700 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=6 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:29:58.384301 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36d405-1059-416c-a6de-ce4185593916 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:29:58.384824 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36d405-1059-416c-a6de-ce4185593916 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:29:58.385007 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36d405-1059-416c-a6de-ce4185593916 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:29:58.388083 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 612/1227] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 24 00:29:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:29:58.393301 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa2de-2678-4883-8473-d383e1a80576 None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:29:58.393940 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa2de-2678-4883-8473-d383e1a80576 None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:29:58.393940 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa2de-2678-4883-8473-d383e1a80576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:29:58.454230 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-358fa2de-2678-4883-8473-d383e1a80576 None None] MFA Rules not processed for user `a863e95438d14892816e4f3c94673025`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:29:58.455652 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-358fa2de-2678-4883-8473-d383e1a80576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:29:58.476702 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 616/1228] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 24 00:29:58 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:29:58.493188 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36d405-1059-416c-a6de-ce4185593916 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:29:58.507319 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36d405-1059-416c-a6de-ce4185593916 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:29:58.522931 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce49c0-573b-4259-ba10-ba5bf283f041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:29:58.523602 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce49c0-573b-4259-ba10-ba5bf283f041 service nova] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:29:58.523886 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce49c0-573b-4259-ba10-ba5bf283f041 service nova] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:29:58.524158 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce49c0-573b-4259-ba10-ba5bf283f041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:29:58.533589 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce49c0-573b-4259-ba10-ba5bf283f041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:29:58.535290 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce49c0-573b-4259-ba10-ba5bf283f041 service nova] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:29:58.547146 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 613/1229] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:29:58 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:30:08.473214 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=17 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:30:08.542280 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=6 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:30:11.957681 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6ddd-7c1e-4998-9031-5c180eacb37e None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:30:11.958352 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6ddd-7c1e-4998-9031-5c180eacb37e None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:30:11.958352 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6ddd-7c1e-4998-9031-5c180eacb37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:30:11.977083 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-c9ae6ddd-7c1e-4998-9031-5c180eacb37e None None] MFA Rules not processed for user `1d5d36e9b4ec4f7fb2d31b35376ecc09`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:30:11.979019 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-c9ae6ddd-7c1e-4998-9031-5c180eacb37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:30:11.986131 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 617/1230] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:30:11 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:30:21.972068 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=3 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:30:34.172556 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce49c0-573b-4259-ba10-ba5bf283f041 service nova] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:30:34.239237 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce49c0-573b-4259-ba10-ba5bf283f041 service nova] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:30:34.242877 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87ccac-e283-4524-a480-34bbe3e72fcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c43d7aa4ecfc4a598bbaa4f4fc4e4590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:30:34.243505 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87ccac-e283-4524-a480-34bbe3e72fcf service cinder] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:30:34.243786 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87ccac-e283-4524-a480-34bbe3e72fcf service cinder] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:30:34.244060 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87ccac-e283-4524-a480-34bbe3e72fcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:30:34.252846 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87ccac-e283-4524-a480-34bbe3e72fcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:30:34.254282 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87ccac-e283-4524-a480-34bbe3e72fcf service cinder] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:30:34.263501 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 614/1231] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:30:34 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:30:35.978764 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae6ddd-7c1e-4998-9031-5c180eacb37e None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:30:35.992080 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae6ddd-7c1e-4998-9031-5c180eacb37e None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:30:35.997829 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766571d-2f0c-4204-b60f-4a4d702ad1a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:30:35.998695 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766571d-2f0c-4204-b60f-4a4d702ad1a5 service nova] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:30:35.998942 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766571d-2f0c-4204-b60f-4a4d702ad1a5 service nova] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:30:35.999240 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766571d-2f0c-4204-b60f-4a4d702ad1a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:30:36.013480 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766571d-2f0c-4204-b60f-4a4d702ad1a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:30:36.015626 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766571d-2f0c-4204-b60f-4a4d702ad1a5 service nova] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:30:36.030591 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 618/1232] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:30:35 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:30:40.007220 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253eadb-bb9d-4ba1-917a-c9bbd6f7a6b1 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:30:40.007749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253eadb-bb9d-4ba1-917a-c9bbd6f7a6b1 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:30:40.007749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253eadb-bb9d-4ba1-917a-c9bbd6f7a6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:30:40.031807 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-b253eadb-bb9d-4ba1-917a-c9bbd6f7a6b1 None None] MFA Rules not processed for user `c8428bb38b72494eb9ce37c3f2978dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:30:40.036550 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-b253eadb-bb9d-4ba1-917a-c9bbd6f7a6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:30:40.044967 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 615/1233] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:30:40 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 00:30:44.637704 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766571d-2f0c-4204-b60f-4a4d702ad1a5 service nova] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:30:44.646908 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766571d-2f0c-4204-b60f-4a4d702ad1a5 service nova] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:30:44.650477 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cae21d-dfb9-4c01-a95a-9f703a3c6704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:30:44.651098 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cae21d-dfb9-4c01-a95a-9f703a3c6704 service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:30:44.651381 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cae21d-dfb9-4c01-a95a-9f703a3c6704 service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:30:44.651655 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cae21d-dfb9-4c01-a95a-9f703a3c6704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:30:44.661115 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cae21d-dfb9-4c01-a95a-9f703a3c6704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:30:44.662544 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cae21d-dfb9-4c01-a95a-9f703a3c6704 service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:30:44.673888 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 619/1234] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:30:44 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:30:45.849178 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253eadb-bb9d-4ba1-917a-c9bbd6f7a6b1 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:30:45.859082 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253eadb-bb9d-4ba1-917a-c9bbd6f7a6b1 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:30:45.862730 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3715a-f88b-40a3-b5e8-fffe02aa5080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:30:45.863366 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3715a-f88b-40a3-b5e8-fffe02aa5080 service neutron] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:30:45.863648 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3715a-f88b-40a3-b5e8-fffe02aa5080 service neutron] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:30:45.863921 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3715a-f88b-40a3-b5e8-fffe02aa5080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:30:45.873217 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3715a-f88b-40a3-b5e8-fffe02aa5080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:30:45.874644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3715a-f88b-40a3-b5e8-fffe02aa5080 service neutron] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:30:45.885182 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 616/1235] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:30:45 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:30:54.669846 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=12 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:30:55.880315 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=39 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:31:11.791523 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cae21d-dfb9-4c01-a95a-9f703a3c6704 service neutron] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:31:11.801507 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cae21d-dfb9-4c01-a95a-9f703a3c6704 service neutron] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:31:11.805592 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a09086-4528-4965-941f-50f937236e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:31:11.806293 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a09086-4528-4965-941f-50f937236e5c service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:31:11.807322 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a09086-4528-4965-941f-50f937236e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:31:11.807667 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a09086-4528-4965-941f-50f937236e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:31:11.815762 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a09086-4528-4965-941f-50f937236e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:31:11.817306 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a09086-4528-4965-941f-50f937236e5c service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:31:11.825423 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 620/1236] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:31:11 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:31:21.821983 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=6 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:32:03.792458 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3715a-f88b-40a3-b5e8-fffe02aa5080 service neutron] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:32:03.807705 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3715a-f88b-40a3-b5e8-fffe02aa5080 service neutron] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:32:03.815322 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23060dd1-a237-4349-8ad4-7f4816507345 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:32:03.816579 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23060dd1-a237-4349-8ad4-7f4816507345 service nova] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:03.816958 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23060dd1-a237-4349-8ad4-7f4816507345 service nova] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:03.817307 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23060dd1-a237-4349-8ad4-7f4816507345 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:03.829067 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23060dd1-a237-4349-8ad4-7f4816507345 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:32:03.831202 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23060dd1-a237-4349-8ad4-7f4816507345 service nova] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:32:03.842370 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 617/1237] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:32:03 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:32:11.588009 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a09086-4528-4965-941f-50f937236e5c service neutron] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:32:11.596522 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a09086-4528-4965-941f-50f937236e5c service neutron] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:32:11.600112 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4768c7-58a6-47f2-9fbd-977888dd7304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:32:11.600698 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4768c7-58a6-47f2-9fbd-977888dd7304 service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:11.600976 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4768c7-58a6-47f2-9fbd-977888dd7304 service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:11.601249 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4768c7-58a6-47f2-9fbd-977888dd7304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:11.660721 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4768c7-58a6-47f2-9fbd-977888dd7304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:32:11.662168 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4768c7-58a6-47f2-9fbd-977888dd7304 service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:32:11.681343 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 621/1238] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:32:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:32:13.838168 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=6 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:32:14.903670 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14216a04-1887-42b3-9759-83de18cbb459 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:14.904235 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14216a04-1887-42b3-9759-83de18cbb459 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:14.904235 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14216a04-1887-42b3-9759-83de18cbb459 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:14.905555 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 618/1239] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 24 00:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:32:14.944128 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fcc64-ef5a-411f-bfd8-b6dde5edfe9c None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:14.944659 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fcc64-ef5a-411f-bfd8-b6dde5edfe9c None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:14.944659 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fcc64-ef5a-411f-bfd8-b6dde5edfe9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:15.009626 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-a30fcc64-ef5a-411f-bfd8-b6dde5edfe9c None None] MFA Rules not processed for user `ebffbdf5a1234167903a9fd4490bb174`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:32:15.011197 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-a30fcc64-ef5a-411f-bfd8-b6dde5edfe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:32:15.033436 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 622/1240] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 24 00:32:14 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:32:15.045835 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278e60b-272e-4fb7-9b8b-1e5643554675 None None] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:15.046218 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278e60b-272e-4fb7-9b8b-1e5643554675 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:15.046562 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278e60b-272e-4fb7-9b8b-1e5643554675 None None] PATH_INFO: `/` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:15.053240 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 619/1241] 10.222.0.42 () {54 vars in 961 bytes} [Wed Aug 24 00:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:32:15.053515 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac113ed-0135-4d5c-9228-75256600763b None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:15.053876 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac113ed-0135-4d5c-9228-75256600763b None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:15.054220 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac113ed-0135-4d5c-9228-75256600763b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:15.074155 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-2ac113ed-0135-4d5c-9228-75256600763b None None] MFA Rules not processed for user `ebffbdf5a1234167903a9fd4490bb174`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:32:15.075481 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-2ac113ed-0135-4d5c-9228-75256600763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:32:15.085158 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 623/1242] 10.222.0.42 () {58 vars in 1058 bytes} [Wed Aug 24 00:32:15 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:32:15.092422 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278e60b-272e-4fb7-9b8b-1e5643554675 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:32:15.105624 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278e60b-272e-4fb7-9b8b-1e5643554675 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:32:15.111996 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638a858-d4af-45bb-8cdb-71df33c8c96a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebffbdf5a1234167903a9fd4490bb174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:32:15.112758 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638a858-d4af-45bb-8cdb-71df33c8c96a service placement] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:15.113032 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638a858-d4af-45bb-8cdb-71df33c8c96a service placement] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:15.113342 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638a858-d4af-45bb-8cdb-71df33c8c96a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:15.121964 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638a858-d4af-45bb-8cdb-71df33c8c96a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:32:15.123735 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638a858-d4af-45bb-8cdb-71df33c8c96a service placement] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:32:15.137664 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 620/1243] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:32:15 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:32:18.359357 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e426c-5ec6-481d-b2c1-6b454368582f None None] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:18.359886 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e426c-5ec6-481d-b2c1-6b454368582f None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:18.359886 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e426c-5ec6-481d-b2c1-6b454368582f None None] PATH_INFO: `/` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:18.361865 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 624/1244] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 24 00:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 00:32:18.389516 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0c4f9-eecf-46e7-a5fa-f5afa235bdd3 None None] REQUEST_METHOD: `POST` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:18.390014 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0c4f9-eecf-46e7-a5fa-f5afa235bdd3 None None] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:18.390105 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0c4f9-eecf-46e7-a5fa-f5afa235bdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:18.409303 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.auth.core [None req-7dc0c4f9-eecf-46e7-a5fa-f5afa235bdd3 None None] MFA Rules not processed for user `ebffbdf5a1234167903a9fd4490bb174`. Rule list: `[]` (Enabled: `True`). {{(pid=94661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:32:18.410548 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-7dc0c4f9-eecf-46e7-a5fa-f5afa235bdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:32:18.420118 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 621/1245] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 24 00:32:18 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:32:18.425363 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e426c-5ec6-481d-b2c1-6b454368582f None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:32:18.439476 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e426c-5ec6-481d-b2c1-6b454368582f None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:32:18.442844 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0c4f9-eecf-46e7-a5fa-f5afa235bdd3 None None] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:32:18.444522 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852be71-0772-4a66-b0db-d49523aa848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:32:18.445139 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852be71-0772-4a66-b0db-d49523aa848e admin admin] REQUEST_METHOD: `DELETE` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:18.445415 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852be71-0772-4a66-b0db-d49523aa848e admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:18.445685 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852be71-0772-4a66-b0db-d49523aa848e admin admin] PATH_INFO: `/v3/users/1d5d36e9b4ec4f7fb2d31b35376ecc09` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:18.446816 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852be71-0772-4a66-b0db-d49523aa848e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d5d36e9b4ec4f7fb2d31b35376ecc09)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:32:18.448803 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852be71-0772-4a66-b0db-d49523aa848e admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:32:18.453349 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0c4f9-eecf-46e7-a5fa-f5afa235bdd3 None None] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:32:18.458300 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86572ac3-7053-48c9-907c-bfc70e63f80d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebffbdf5a1234167903a9fd4490bb174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:32:18.458891 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86572ac3-7053-48c9-907c-bfc70e63f80d service placement] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:18.459267 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86572ac3-7053-48c9-907c-bfc70e63f80d service placement] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:18.459542 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86572ac3-7053-48c9-907c-bfc70e63f80d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:18.468093 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86572ac3-7053-48c9-907c-bfc70e63f80d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:32:18.469675 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86572ac3-7053-48c9-907c-bfc70e63f80d service placement] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:32:18.481570 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 622/1246] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:32:18 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 00:32:18.500885 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-6852be71-0772-4a66-b0db-d49523aa848e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d5d36e9b4ec4f7fb2d31b35376ecc09'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:18.502286 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-6852be71-0772-4a66-b0db-d49523aa848e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d5d36e9b4ec4f7fb2d31b35376ecc09'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:18.510612 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-6852be71-0772-4a66-b0db-d49523aa848e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d5d36e9b4ec4f7fb2d31b35376ecc09'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:18.527678 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-6852be71-0772-4a66-b0db-d49523aa848e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d5d36e9b4ec4f7fb2d31b35376ecc09'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:18.535111 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-6852be71-0772-4a66-b0db-d49523aa848e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d5d36e9b4ec4f7fb2d31b35376ecc09'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:18.541480 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 625/1247] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 00:32:18 2022] DELETE /identity/v3/users/1d5d36e9b4ec4f7fb2d31b35376ecc09 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:32:18.723516 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86572ac3-7053-48c9-907c-bfc70e63f80d service placement] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:32:18.735506 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86572ac3-7053-48c9-907c-bfc70e63f80d service placement] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:32:18.801000 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be63db6-81cc-45f2-8da1-8fa3d90ab718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:32:18.801619 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be63db6-81cc-45f2-8da1-8fa3d90ab718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:18.801898 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be63db6-81cc-45f2-8da1-8fa3d90ab718 admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:18.802171 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be63db6-81cc-45f2-8da1-8fa3d90ab718 admin admin] PATH_INFO: `/v3/projects/f3789086be774bee8792a7b41c5c47a0` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:18.803317 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be63db6-81cc-45f2-8da1-8fa3d90ab718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3789086be774bee8792a7b41c5c47a0)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:32:18.805233 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be63db6-81cc-45f2-8da1-8fa3d90ab718 admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:32:18.850971 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-7be63db6-81cc-45f2-8da1-8fa3d90ab718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3789086be774bee8792a7b41c5c47a0', 'request_id': 'req-7be63db6-81cc-45f2-8da1-8fa3d90ab718'} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:18.857496 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-7be63db6-81cc-45f2-8da1-8fa3d90ab718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3789086be774bee8792a7b41c5c47a0', 'request_id': 'req-7be63db6-81cc-45f2-8da1-8fa3d90ab718'} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:18.863709 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-7be63db6-81cc-45f2-8da1-8fa3d90ab718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3789086be774bee8792a7b41c5c47a0', 'request_id': 'req-7be63db6-81cc-45f2-8da1-8fa3d90ab718'} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:18.875576 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-7be63db6-81cc-45f2-8da1-8fa3d90ab718 admin admin] The token cache is being invalidate because project f3789086be774bee8792a7b41c5c47a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 00:32:18.875864 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-7be63db6-81cc-45f2-8da1-8fa3d90ab718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:18.876652 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-7be63db6-81cc-45f2-8da1-8fa3d90ab718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:18.878219 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 623/1248] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 00:32:18 2022] DELETE /identity/v3/projects/f3789086be774bee8792a7b41c5c47a0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:32:18.882423 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852be71-0772-4a66-b0db-d49523aa848e admin admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:32:18.884010 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-6852be71-0772-4a66-b0db-d49523aa848e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:32:18.897209 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852be71-0772-4a66-b0db-d49523aa848e admin admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:32:18.905568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:32:18.959419 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372b64b-607f-4119-adbb-fc9bdbaea8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:32:18.960189 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372b64b-607f-4119-adbb-fc9bdbaea8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:18.960552 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372b64b-607f-4119-adbb-fc9bdbaea8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:18.960836 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372b64b-607f-4119-adbb-fc9bdbaea8a6 admin admin] PATH_INFO: `/v3/users/c1dd8686bbf242e0bffe3a5c32d51fa4` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:18.961985 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372b64b-607f-4119-adbb-fc9bdbaea8a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1dd8686bbf242e0bffe3a5c32d51fa4)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:32:18.964032 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372b64b-607f-4119-adbb-fc9bdbaea8a6 admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:32:19.012526 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-c372b64b-607f-4119-adbb-fc9bdbaea8a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1dd8686bbf242e0bffe3a5c32d51fa4'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:19.013191 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-c372b64b-607f-4119-adbb-fc9bdbaea8a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1dd8686bbf242e0bffe3a5c32d51fa4'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:19.022670 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-c372b64b-607f-4119-adbb-fc9bdbaea8a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1dd8686bbf242e0bffe3a5c32d51fa4'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:19.036849 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-c372b64b-607f-4119-adbb-fc9bdbaea8a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1dd8686bbf242e0bffe3a5c32d51fa4'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:19.043781 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-c372b64b-607f-4119-adbb-fc9bdbaea8a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1dd8686bbf242e0bffe3a5c32d51fa4'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:19.049619 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 626/1249] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 00:32:18 2022] DELETE /identity/v3/users/c1dd8686bbf242e0bffe3a5c32d51fa4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:32:19.219939 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be63db6-81cc-45f2-8da1-8fa3d90ab718 admin admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:32:19.222057 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-7be63db6-81cc-45f2-8da1-8fa3d90ab718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:32:19.234751 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be63db6-81cc-45f2-8da1-8fa3d90ab718 admin admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:32:19.286260 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:32:19.293321 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5e993-04ef-4a1d-8ce5-34f18a0db1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:32:19.294159 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5e993-04ef-4a1d-8ce5-34f18a0db1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:19.294444 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5e993-04ef-4a1d-8ce5-34f18a0db1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:19.295066 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5e993-04ef-4a1d-8ce5-34f18a0db1fb admin admin] PATH_INFO: `/v3/projects/fcba40a2efb8414590fa4cb42de22d60` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:19.296553 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5e993-04ef-4a1d-8ce5-34f18a0db1fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcba40a2efb8414590fa4cb42de22d60)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:32:19.299164 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5e993-04ef-4a1d-8ce5-34f18a0db1fb admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:32:19.345129 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-9ae5e993-04ef-4a1d-8ce5-34f18a0db1fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcba40a2efb8414590fa4cb42de22d60', 'request_id': 'req-9ae5e993-04ef-4a1d-8ce5-34f18a0db1fb'} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:19.351089 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-9ae5e993-04ef-4a1d-8ce5-34f18a0db1fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcba40a2efb8414590fa4cb42de22d60', 'request_id': 'req-9ae5e993-04ef-4a1d-8ce5-34f18a0db1fb'} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:19.356687 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-9ae5e993-04ef-4a1d-8ce5-34f18a0db1fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcba40a2efb8414590fa4cb42de22d60', 'request_id': 'req-9ae5e993-04ef-4a1d-8ce5-34f18a0db1fb'} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:19.368750 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-9ae5e993-04ef-4a1d-8ce5-34f18a0db1fb admin admin] The token cache is being invalidate because project fcba40a2efb8414590fa4cb42de22d60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 00:32:19.369031 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-9ae5e993-04ef-4a1d-8ce5-34f18a0db1fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:19.369644 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-9ae5e993-04ef-4a1d-8ce5-34f18a0db1fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:32:19.371117 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 624/1250] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 00:32:19 2022] DELETE /identity/v3/projects/fcba40a2efb8414590fa4cb42de22d60 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:32:29.046123 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=48,keystone:DELETE=10,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:32:29.365317 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:32:33.662807 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e79f7-b312-4650-add2-36f3f16dd67d None None] REQUEST_METHOD: `POST` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:33.663327 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e79f7-b312-4650-add2-36f3f16dd67d None None] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:33.663432 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e79f7-b312-4650-add2-36f3f16dd67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:33.683360 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.auth.core [None req-e65e79f7-b312-4650-add2-36f3f16dd67d None None] MFA Rules not processed for user `c8428bb38b72494eb9ce37c3f2978dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=94660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 00:32:33.684611 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-e65e79f7-b312-4650-add2-36f3f16dd67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:32:33.740681 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 627/1251] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 00:32:33 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 00:32:34.059268 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5e993-04ef-4a1d-8ce5-34f18a0db1fb admin admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:32:34.060782 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-9ae5e993-04ef-4a1d-8ce5-34f18a0db1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:32:34.118047 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5e993-04ef-4a1d-8ce5-34f18a0db1fb admin admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:32:34.121528 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcdeb0-82e3-4bc2-a856-68d59cc407db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:32:34.122125 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcdeb0-82e3-4bc2-a856-68d59cc407db service neutron] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:34.122402 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcdeb0-82e3-4bc2-a856-68d59cc407db service neutron] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:34.122671 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcdeb0-82e3-4bc2-a856-68d59cc407db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:34.124382 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-10fcdeb0-82e3-4bc2-a856-68d59cc407db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:32:34.134341 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcdeb0-82e3-4bc2-a856-68d59cc407db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:32:34.135805 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcdeb0-82e3-4bc2-a856-68d59cc407db service neutron] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:32:34.143408 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 625/1252] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:32:34 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:32:34.592568 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e79f7-b312-4650-add2-36f3f16dd67d None None] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:32:34.594030 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-e65e79f7-b312-4650-add2-36f3f16dd67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:32:34.664780 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e79f7-b312-4650-add2-36f3f16dd67d None None] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:32:34.669727 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca92078-f25a-438e-9433-627da8f2c2c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebffbdf5a1234167903a9fd4490bb174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:32:34.670328 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca92078-f25a-438e-9433-627da8f2c2c4 service placement] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:34.670606 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca92078-f25a-438e-9433-627da8f2c2c4 service placement] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:34.670877 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca92078-f25a-438e-9433-627da8f2c2c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:34.672622 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-9ca92078-f25a-438e-9433-627da8f2c2c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:32:34.683629 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca92078-f25a-438e-9433-627da8f2c2c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:32:34.685204 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca92078-f25a-438e-9433-627da8f2c2c4 service placement] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:32:34.694710 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 628/1253] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:32:34 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:32:42.368131 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcdeb0-82e3-4bc2-a856-68d59cc407db service neutron] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:32:42.369617 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-10fcdeb0-82e3-4bc2-a856-68d59cc407db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:32:42.440603 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcdeb0-82e3-4bc2-a856-68d59cc407db service neutron] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:32:42.446500 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709da0d-6f65-4b09-b90d-4e6761d1ce63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:32:42.447134 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709da0d-6f65-4b09-b90d-4e6761d1ce63 service nova] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:32:42.447411 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709da0d-6f65-4b09-b90d-4e6761d1ce63 service nova] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:32:42.447685 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709da0d-6f65-4b09-b90d-4e6761d1ce63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:32:42.449386 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-2709da0d-6f65-4b09-b90d-4e6761d1ce63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:32:42.463569 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709da0d-6f65-4b09-b90d-4e6761d1ce63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:32:42.465075 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709da0d-6f65-4b09-b90d-4e6761d1ce63 service nova] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:32:42.474686 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 626/1254] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:32:42 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:32:44.690770 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=57 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:32:52.470703 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=58 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:33:52.304498 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca92078-f25a-438e-9433-627da8f2c2c4 service placement] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:33:52.305882 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-9ca92078-f25a-438e-9433-627da8f2c2c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:33:52.369007 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca92078-f25a-438e-9433-627da8f2c2c4 service placement] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:33:52.374000 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5411e-1b0f-4237-a0c7-a72bc9bfc416 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebffbdf5a1234167903a9fd4490bb174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:33:52.374587 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5411e-1b0f-4237-a0c7-a72bc9bfc416 service placement] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:33:52.374867 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5411e-1b0f-4237-a0c7-a72bc9bfc416 service placement] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:33:52.375175 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5411e-1b0f-4237-a0c7-a72bc9bfc416 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:33:52.376864 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-51a5411e-1b0f-4237-a0c7-a72bc9bfc416 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:33:52.388322 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5411e-1b0f-4237-a0c7-a72bc9bfc416 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:33:52.389881 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5411e-1b0f-4237-a0c7-a72bc9bfc416 service placement] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:33:52.399807 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 629/1255] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:33:52 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:34:02.395448 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=28 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:35:05.288547 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709da0d-6f65-4b09-b90d-4e6761d1ce63 service nova] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:35:05.290072 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-2709da0d-6f65-4b09-b90d-4e6761d1ce63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:35:05.366367 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709da0d-6f65-4b09-b90d-4e6761d1ce63 service nova] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:35:05.372062 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2518f4-2740-44a6-bcb3-c54c8e244b23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a863e95438d14892816e4f3c94673025', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:35:05.372447 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2518f4-2740-44a6-bcb3-c54c8e244b23 service nova] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:35:05.372732 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2518f4-2740-44a6-bcb3-c54c8e244b23 service nova] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:35:05.373005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2518f4-2740-44a6-bcb3-c54c8e244b23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:35:05.375844 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-3b2518f4-2740-44a6-bcb3-c54c8e244b23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:35:05.388826 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2518f4-2740-44a6-bcb3-c54c8e244b23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:35:05.391021 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2518f4-2740-44a6-bcb3-c54c8e244b23 service nova] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:35:05.402462 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 627/1256] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:35:05 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:35:12.861179 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5411e-1b0f-4237-a0c7-a72bc9bfc416 service placement] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:35:12.862592 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-51a5411e-1b0f-4237-a0c7-a72bc9bfc416 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:35:12.873549 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5411e-1b0f-4237-a0c7-a72bc9bfc416 service placement] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:35:12.877138 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6462b5c-06d1-4415-8c9f-50fc5b48ff79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad894f6b3613401c88cd3b39d825e61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:35:12.877714 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6462b5c-06d1-4415-8c9f-50fc5b48ff79 service neutron] REQUEST_METHOD: `GET` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:35:12.877990 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6462b5c-06d1-4415-8c9f-50fc5b48ff79 service neutron] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:35:12.878257 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6462b5c-06d1-4415-8c9f-50fc5b48ff79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:35:12.879919 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-d6462b5c-06d1-4415-8c9f-50fc5b48ff79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:35:12.977030 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6462b5c-06d1-4415-8c9f-50fc5b48ff79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:35:12.978488 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6462b5c-06d1-4415-8c9f-50fc5b48ff79 service neutron] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:35:12.989365 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 630/1257] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:35:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:35:15.397608 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=28 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:35:19.258700 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2518f4-2740-44a6-bcb3-c54c8e244b23 service nova] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:35:19.260788 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-3b2518f4-2740-44a6-bcb3-c54c8e244b23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:35:19.275480 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2518f4-2740-44a6-bcb3-c54c8e244b23 service nova] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:35:19.280244 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280655b6-1b70-4aaf-948d-1b20e90e546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:35:19.280876 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280655b6-1b70-4aaf-948d-1b20e90e546e admin admin] REQUEST_METHOD: `DELETE` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:35:19.281151 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280655b6-1b70-4aaf-948d-1b20e90e546e admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:35:19.281680 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280655b6-1b70-4aaf-948d-1b20e90e546e admin admin] PATH_INFO: `/v3/users/c8428bb38b72494eb9ce37c3f2978dd4` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:35:19.282809 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280655b6-1b70-4aaf-948d-1b20e90e546e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8428bb38b72494eb9ce37c3f2978dd4)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:35:19.283912 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: WARNING py.warnings [None req-280655b6-1b70-4aaf-948d-1b20e90e546e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:35:19.283912 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: warnings.warn(msg) Aug 24 00:35:19.283912 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: Aug 24 00:35:19.285110 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280655b6-1b70-4aaf-948d-1b20e90e546e admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:35:19.353855 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-280655b6-1b70-4aaf-948d-1b20e90e546e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8428bb38b72494eb9ce37c3f2978dd4'} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:19.354515 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-280655b6-1b70-4aaf-948d-1b20e90e546e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8428bb38b72494eb9ce37c3f2978dd4'} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:19.361846 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-280655b6-1b70-4aaf-948d-1b20e90e546e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8428bb38b72494eb9ce37c3f2978dd4'} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:19.384762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-280655b6-1b70-4aaf-948d-1b20e90e546e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8428bb38b72494eb9ce37c3f2978dd4'} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:19.397911 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-280655b6-1b70-4aaf-948d-1b20e90e546e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8428bb38b72494eb9ce37c3f2978dd4'} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:19.404273 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 628/1258] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 00:35:19 2022] DELETE /identity/v3/users/c8428bb38b72494eb9ce37c3f2978dd4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:35:19.588035 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6462b5c-06d1-4415-8c9f-50fc5b48ff79 service neutron] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:35:19.598030 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6462b5c-06d1-4415-8c9f-50fc5b48ff79 service neutron] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:35:19.656070 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc22ee-3885-4188-8bed-affabfe2f605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:35:19.656892 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc22ee-3885-4188-8bed-affabfe2f605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:35:19.657168 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc22ee-3885-4188-8bed-affabfe2f605 admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:35:19.657439 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc22ee-3885-4188-8bed-affabfe2f605 admin admin] PATH_INFO: `/v3/projects/757272a76f804a22a7ecb549bae0416c` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:35:19.658540 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc22ee-3885-4188-8bed-affabfe2f605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=757272a76f804a22a7ecb549bae0416c)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:35:19.659595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: WARNING py.warnings [None req-1adc22ee-3885-4188-8bed-affabfe2f605 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 00:35:19.659595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: warnings.warn(msg) Aug 24 00:35:19.659595 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: Aug 24 00:35:19.660794 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc22ee-3885-4188-8bed-affabfe2f605 admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:35:19.714701 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-1adc22ee-3885-4188-8bed-affabfe2f605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '757272a76f804a22a7ecb549bae0416c', 'request_id': 'req-1adc22ee-3885-4188-8bed-affabfe2f605'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:19.728401 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-1adc22ee-3885-4188-8bed-affabfe2f605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '757272a76f804a22a7ecb549bae0416c', 'request_id': 'req-1adc22ee-3885-4188-8bed-affabfe2f605'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:19.734586 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-1adc22ee-3885-4188-8bed-affabfe2f605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '757272a76f804a22a7ecb549bae0416c', 'request_id': 'req-1adc22ee-3885-4188-8bed-affabfe2f605'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:19.746114 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-1adc22ee-3885-4188-8bed-affabfe2f605 admin admin] The token cache is being invalidate because project 757272a76f804a22a7ecb549bae0416c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 00:35:19.746404 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-1adc22ee-3885-4188-8bed-affabfe2f605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:19.747054 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-1adc22ee-3885-4188-8bed-affabfe2f605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:19.748553 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 631/1259] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 00:35:19 2022] DELETE /identity/v3/projects/757272a76f804a22a7ecb549bae0416c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:35:19.752609 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280655b6-1b70-4aaf-948d-1b20e90e546e admin admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:35:19.754025 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-280655b6-1b70-4aaf-948d-1b20e90e546e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:35:19.766896 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280655b6-1b70-4aaf-948d-1b20e90e546e admin admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:35:19.824283 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373facf5-742e-4ffb-9ac7-f4d8d6787abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:35:19.824916 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373facf5-742e-4ffb-9ac7-f4d8d6787abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:35:19.825198 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373facf5-742e-4ffb-9ac7-f4d8d6787abe admin admin] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:35:19.825475 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373facf5-742e-4ffb-9ac7-f4d8d6787abe admin admin] PATH_INFO: `/v3/users/54df5c8ddd274c408152194a1678911c` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:35:19.826597 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373facf5-742e-4ffb-9ac7-f4d8d6787abe admin admin] RBAC: Authorizing `identity:delete_user(user_id=54df5c8ddd274c408152194a1678911c)` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:35:19.828591 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373facf5-742e-4ffb-9ac7-f4d8d6787abe admin admin] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:35:19.874749 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-373facf5-742e-4ffb-9ac7-f4d8d6787abe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54df5c8ddd274c408152194a1678911c'} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:19.875419 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-373facf5-742e-4ffb-9ac7-f4d8d6787abe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54df5c8ddd274c408152194a1678911c'} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:19.883369 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-373facf5-742e-4ffb-9ac7-f4d8d6787abe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54df5c8ddd274c408152194a1678911c'} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:19.895492 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-373facf5-742e-4ffb-9ac7-f4d8d6787abe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54df5c8ddd274c408152194a1678911c'} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:19.898014 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:35:19.905102 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.notifications [None req-373facf5-742e-4ffb-9ac7-f4d8d6787abe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54df5c8ddd274c408152194a1678911c'} {{(pid=94661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:19.911493 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 629/1260] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 00:35:19 2022] DELETE /identity/v3/users/54df5c8ddd274c408152194a1678911c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:35:20.085854 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc22ee-3885-4188-8bed-affabfe2f605 admin admin] Authenticating user token {{(pid=94660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:35:20.087463 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.fernet_utils [None req-1adc22ee-3885-4188-8bed-affabfe2f605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:35:20.101898 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:35:20.105959 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc22ee-3885-4188-8bed-affabfe2f605 admin admin] Validating token access rules against request {{(pid=94660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:35:20.168196 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20a876-23ab-4740-b3fd-fb9e37d3b181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9622273acc4179a07cafb4c9699780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792d367d504f4db2950fddd56501d7c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:35:20.168823 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20a876-23ab-4740-b3fd-fb9e37d3b181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:35:20.169101 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20a876-23ab-4740-b3fd-fb9e37d3b181 admin admin] SCRIPT_NAME: `/identity` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:35:20.169372 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20a876-23ab-4740-b3fd-fb9e37d3b181 admin admin] PATH_INFO: `/v3/projects/0cd7caa079674542b11075764223a032` {{(pid=94660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:35:20.170486 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20a876-23ab-4740-b3fd-fb9e37d3b181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd7caa079674542b11075764223a032)` {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:35:20.172488 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20a876-23ab-4740-b3fd-fb9e37d3b181 admin admin] RBAC: Authorization granted {{(pid=94660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:35:20.220462 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-9e20a876-23ab-4740-b3fd-fb9e37d3b181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd7caa079674542b11075764223a032', 'request_id': 'req-9e20a876-23ab-4740-b3fd-fb9e37d3b181'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:20.226926 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-9e20a876-23ab-4740-b3fd-fb9e37d3b181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd7caa079674542b11075764223a032', 'request_id': 'req-9e20a876-23ab-4740-b3fd-fb9e37d3b181'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:20.232426 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-9e20a876-23ab-4740-b3fd-fb9e37d3b181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd7caa079674542b11075764223a032', 'request_id': 'req-9e20a876-23ab-4740-b3fd-fb9e37d3b181'} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:20.247160 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-9e20a876-23ab-4740-b3fd-fb9e37d3b181 admin admin] The token cache is being invalidate because project 0cd7caa079674542b11075764223a032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 00:35:20.247447 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-9e20a876-23ab-4740-b3fd-fb9e37d3b181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:20.248065 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG keystone.notifications [None req-9e20a876-23ab-4740-b3fd-fb9e37d3b181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 00:35:20.249547 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: [pid: 94660|app: 0|req: 632/1261] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 00:35:20 2022] DELETE /identity/v3/projects/0cd7caa079674542b11075764223a032 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 00:35:29.908086 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=4 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:35:30.244295 dv-osbrick-853778-3-ceph devstack@keystone.service[94660]: DEBUG dbcounter [-] [94660] Writing DB stats keystone:SELECT=49,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 00:38:55.251319 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373facf5-742e-4ffb-9ac7-f4d8d6787abe admin admin] Authenticating user token {{(pid=94661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 00:38:55.252693 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-373facf5-742e-4ffb-9ac7-f4d8d6787abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:38:55.321562 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373facf5-742e-4ffb-9ac7-f4d8d6787abe admin admin] Validating token access rules against request {{(pid=94661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 00:38:55.377964 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26513b-cdca-4f26-a636-f0f4487a53b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebffbdf5a1234167903a9fd4490bb174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a63a68d37106431e80bd876cdce3e5fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 00:38:55.378488 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26513b-cdca-4f26-a636-f0f4487a53b8 service placement] REQUEST_METHOD: `GET` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 00:38:55.378762 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26513b-cdca-4f26-a636-f0f4487a53b8 service placement] SCRIPT_NAME: `/identity` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 00:38:55.379062 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26513b-cdca-4f26-a636-f0f4487a53b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 00:38:55.380748 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.fernet_utils [None req-5c26513b-cdca-4f26-a636-f0f4487a53b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 00:38:55.392005 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26513b-cdca-4f26-a636-f0f4487a53b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 00:38:55.393564 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26513b-cdca-4f26-a636-f0f4487a53b8 service placement] RBAC: Authorization granted {{(pid=94661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 00:38:55.403529 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: [pid: 94661|app: 0|req: 630/1262] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 00:38:55 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 00:39:05.399167 dv-osbrick-853778-3-ceph devstack@keystone.service[94661]: DEBUG dbcounter [-] [94661] Writing DB stats keystone:SELECT=58 {{(pid=94661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}